00000001:02000400:2.0F:1788683959.909410:0:3298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788683969.558690:0:3500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788683971.356552:0:3561:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 527 MB/s 00000001:01000000:3.0F:1788683971.606515:0:3561:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 623 MB/s 00000001:01000000:2.0:1788683971.857436:0:3561:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4143 MB/s 00000020:02000000:1.0F:1788683972.580237:0:3591:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g2f2534e 00000400:02000000:2.0:1788683973.342595:0:3607:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.144@tcp [8/256/0/180] 00008000:02000000:3.0:1788683977.170584:0:3756:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788684029.751713:0:5725:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788684041.719219:0:6474:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788684041.719228:0:6474:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788684041.719230:0:6474:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788684041.719459:0:6474:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000925b390 00000080:02000400:1.0:1788684041.719474:0:6474:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788684041.727023:0:6474:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788684041.727036:0:6474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788684041.727496:0:6474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ae32cafa) 00000020:00000080:0.0:1788684041.727520:0:6474:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788684041.775539:0:6474:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788684041.775816:0:6474:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788684041.822266:0:6474:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788684041.822598:0:6474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788684041.822608:0:6474:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788684041.822622:0:6474:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54abe0c 00000020:01000004:2.0:1788684041.822631:0:6474:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788684041.822637:0:6474:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788684041.822641:0:6474:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000925b390 from MGS 00000020:01000004:2.0:1788684041.822646:0:6474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788684041.822664:0:6474:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c26e1390) 00000020:00000080:2.0:1788684041.822685:0:6474:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788684041.822777:0:6474:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000925b390 from MGS, refs=2 00080000:01000000:2.0:1788684041.822782:0:6474:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788684041.822787:0:6474:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54abe1a 00000100:00100000:2.0:1788684041.822972:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788684041.823123:0:6474:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788684041.823130:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788684041.824206:0:6474:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788684041.824216:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788684041.826331:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684041.827011:0:6474:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788684041.827019:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788684041.828109:0:6474:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788684041.828119:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788684041.828981:0:6474:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788684041.828992:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788684041.830738:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684041.830745:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684041.830747:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684041.831330:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684041.831334:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684041.831341:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684041.832154:0:6474:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788684041.833932:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788684042.082246:0:6474:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2771 MB/s 00000001:01000000:3.0:1788684042.332406:0:6474:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3187 MB/s 00000001:01000000:0.0:1788684042.583471:0:6474:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 545 MB/s 00000001:01000000:2.0:1788684042.834586:0:6474:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 681 MB/s 00080000:10000000:3.0:1788684042.845974:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1788684042.865503:0:6474:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788684042.866175:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788684042.866520:0:6474:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788684042.866552:0:6474:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788684042.866722:0:6474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788684042.866745:0:6474:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788684042.867082:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788684042.867723:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788684042.867730:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788684042.868629:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788684042.868639:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788684042.869060:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788684042.869067:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788684042.870053:0:6474:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788684042.870075:0:6474:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.144@tcp' 00000020:01000004:3.0:1788684042.870077:0:6474:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788684042.870126:0:6474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.144@tcp (typ=mgc) 00000020:00000080:3.0:1788684042.870148:0:6474:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.144@tcp (000000000b8f66de) 00000020:00000080:3.0:1788684042.870164:0:6474:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788684042.870308:0:6474:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000054ab7a2a@MGC192.168.206.144@tcp: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684042.870646:0:6474:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.144@tcp-0 is initialized 00000040:01000000:3.0:1788684042.870652:0:6474:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788684042.871044:0:6492:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1788684042.899549:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788684042.920135:0:6495:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788684042.920261:0:6474:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.144@tcp (uuid eb0a8256-d625-4e80-aa6e-17b94cff8c50) 00000020:00000080:0.0:1788684042.920286:0:6474:0:(genops.c:1385:class_connect()) connect: client eb0a8256-d625-4e80-aa6e-17b94cff8c50, cookie 0x44bac02bd54abe28 00000100:00080000:0.0:1788684042.920297:0:6474:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788684042.920318:0:6474:0:(import.c:665:import_select_connection()) MGC192.168.206.144@tcp: import 0000000054ab7a2a using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684042.920397:0:6474:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000db201821 x1875571085672576/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684042.920418:0:6474:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS 00000020:01000004:0.0:1788684042.920439:0:6474:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788684042.920444:0:6474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788684042.920456:0:6474:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d682dba9) 00000020:00000080:0.0:1788684042.920468:0:6474:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788684042.920740:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db201821 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3622:1875571085672576:0@lo:250: 00000100:00100000:1.0:1788684042.920820:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684042.920897:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085672576 00000100:00100000:1.0:1788684042.920903:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085672576 00000100:00100000:1.0:1788684042.920938:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684042.920945:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e4cdb2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3622:x1875571085672576:12345-0@lo:250: 00010000:00080000:1.0:1788684042.920965:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from eb0a8256-d625-4e80-aa6e-17b94cff8c50@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:1.0:1788684042.920985:0:6489:0:(genops.c:1385:class_connect()) connect: client eb0a8256-d625-4e80-aa6e-17b94cff8c50, cookie 0x44bac02bd54abe36 00000100:00080000:1.0:1788684042.921094:0:6489:0:(import.c:65:import_set_state_nolock()) 00000000012b009a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684042.921142:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e4cdb2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:3622:x1875571085672576:12345-0@lo:250: Request processed in 197us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684042.921149:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684042.921191:0:3622:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788684042.921199:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.144@tcp: connect to target with instance 0 00000100:00080000:1.0:1788684042.921204:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788684042.921207:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788684042.921210:0:3622:0:(import.c:65:import_set_state_nolock()) 0000000054ab7a2a MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788684042.921212:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788684042.921218:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788684042.921221:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db201821 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3622:1875571085672576:0@lo:250: 00000100:00100000:0.0:1788684042.956227:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684042.960640:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788684042.960651:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788684042.966954:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788684042.969164:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788684042.970073:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788684042.970083:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788684042.972861:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788684042.973025:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788684042.973030:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788684042.976179:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788684042.976203:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788684043.033648:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788684043.034043:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788684043.034050:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788684043.035141:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788684043.035150:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788684043.039596:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788684043.039788:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788684043.039794:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788684043.040307:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788684043.040319:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788684043.040963:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788684043.041100:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788684043.041105:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788684043.041919:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788684043.041927:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788684043.042533:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788684043.042709:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788684043.042714:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788684043.043553:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788684043.043563:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788684043.070583:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684043.070804:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788684043.070810:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788684043.074680:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788684043.074694:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788684043.080266:0:6474:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788684043.080281:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788684043.085616:0:6474:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788684043.085653:0:6474:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788684043.085681:0:6474:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788684043.085780:0:6474:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788684043.085815:0:6474:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788684043.085819:0:6474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788684043.085821:0:6474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684043.085823:0:6474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684043.085824:0:6474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684043.085825:0:6474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684043.085826:0:6474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684043.085828:0:6474:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684043.085829:0:6474:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684043.085830:0:6474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684043.085831:0:6474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684043.085833:0:6474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684043.085835:0:6474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788684043.085837:0:6474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788684043.085839:0:6474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684043.085841:0:6474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684043.085842:0:6474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684043.085843:0:6474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684043.085844:0:6474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684043.085845:0:6474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684043.085846:0:6474:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684043.085847:0:6474:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684043.085848:0:6474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684043.085849:0:6474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684043.085850:0:6474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684043.085851:0:6474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788684043.085887:0:6474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788684043.085902:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085672704:0@lo:253: 00000100:00100000:3.0:1788684043.085978:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684043.086020:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e42ee7af going to sleep for 11 seconds 00000100:00100000:1.0:1788684043.086559:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085672704 00000100:00100000:1.0:1788684043.086573:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085672704 00000100:00100000:1.0:1788684043.086659:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684043.086678:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000870c59eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:6474:x1875571085672704:12345-0@lo:253: 20000000:01000000:1.0:1788684043.086724:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788684043.086727:0:6491:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788684043.088253:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788684043.088527:0:6491:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788684043.088855:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684043.089886:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788684043.090648:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788684043.090653:0:6491:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788684043.090659:0:6491:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788684043.090662:0:6491:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788684043.090686:0:6491:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788684043.090846:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684043.091036:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788684043.091053:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788684043.091070:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788684043.091085:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788684043.091098:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788684043.091144:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788684043.091153:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788684043.091166:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788684043.091171:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788684043.091181:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788684043.091185:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788684043.091196:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788684043.091209:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788684043.091234:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788684043.091239:0:6491:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788684043.091245:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684043.091328:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788684043.091338:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788684043.091354:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788684043.092709:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788684043.092732:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788684043.092744:0:6491:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788684043.092783:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788684043.092793:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788684043.092806:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788684043.092820:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788684043.092836:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788684043.092845:0:6491:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788684043.092868:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788684043.092875:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788684043.092889:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788684043.093143:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788684043.093219:0:6491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788684043.093243:0:6491:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788684043.093249:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788684043.093820:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788684043.094013:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788684043.094033:0:6491:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.144@tcp for mdt 20000000:01000000:1.0:1788684043.094035:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:1.0:1788684043.094052:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788684043.094058:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788684043.094072:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788684043.094077:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:1.0:1788684043.094088:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788684043.094094:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788684043.094106:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788684043.094119:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788684043.094144:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788684043.094147:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788684043.094151:0:6491:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788684043.094609:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788684043.094616:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788684043.095447:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788684043.095706:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788684043.095734:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788684043.095749:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788684043.095762:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788684043.095763:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788684043.096128:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788684043.096265:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788684043.096287:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788684043.096303:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788684043.096313:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788684043.096316:0:6491:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788684043.096320:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788684043.096322:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788684043.096326:0:6491:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788684043.096332:0:6491:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788684043.096867:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788684043.097587:0:6491:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788684043.105343:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788684043.105398:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788684043.105412:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788684043.105429:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788684043.105448:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105464:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105473:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105479:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105485:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105506:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105512:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ae1bbf1e already unused, calling callback (0000000048a072f0) 00010000:00010000:1.0:1788684043.105515:0:6491:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105523:0:6491:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105534:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105541:0:6491:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.105547:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe3d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788684043.105565:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788684043.120605:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000870c59eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:6474:x1875571085672704:12345-0@lo:253: Request processed in 33931us (34619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684043.120745:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684043.121329:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085672704:0@lo:253: 10000000:01000000:3.0:1788684043.121355:0:6474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788684043.121358:0:6474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684043.121360:0:6474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684043.121362:0:6474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684043.121383:0:6474:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788684043.121385:0:6474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684043.121386:0:6474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684043.121387:0:6474:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684043.121388:0:6474:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684043.121389:0:6474:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788684043.121391:0:6474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684043.121392:0:6474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788684043.121413:0:6474:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000925b390 from lustre-MDT0000 10000000:01000000:3.0:1788684043.121442:0:6474:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788684043.121445:0:6474:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788684043.121449:0:6474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d67482e3380 10000000:01000000:3.0:1788684043.121453:0:6474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788684043.121462:0:6474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d67482e3380 from 1 10000000:01000000:3.0:1788684043.121465:0:6474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788684043.121499:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.121510:0:6474:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.121518:0:6474:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684043.121549:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085672832:0@lo:101: 00000100:00100000:3.0:1788684043.121592:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684043.121638:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094299ace going to sleep for 11 seconds 00000100:00100000:1.0:1788684043.121851:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085672832 00000100:00100000:1.0:1788684043.121858:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085672832 00000100:00100000:1.0:1788684043.121891:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684043.121897:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000092cf56a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:6474:x1875571085672832:12345-0@lo:101: 00010000:00010000:1.0:1788684043.121921:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684043.121933:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abe44 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.121953:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abe44 expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.121973:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abe44 expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.121982:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae1bbf1e, rc 0) 00000100:00100000:1.0:1788684043.122023:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000092cf56a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:6474:x1875571085672832:12345-0@lo:101: Request processed in 126us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684043.122029:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684043.122170:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085672832:0@lo:101: 00010000:00010000:3.0:1788684043.122190:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.122198:0:6474:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684043.122246:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085672960:0@lo:501: 00000100:00100000:3.0:1788684043.122270:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684043.122292:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094299ace going to sleep for 11 seconds 00000100:00100000:2.0:1788684043.122529:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085672960 00000100:00100000:2.0:1788684043.122544:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085672960 00000100:00100000:2.0:1788684043.122575:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684043.122580:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a3079b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:6474:x1875571085672960:12345-0@lo:501: 00000100:00100000:2.0:1788684043.122659:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a3079b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:6474:x1875571085672960:12345-0@lo:501: Request processed in 79us (388us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788684043.122666:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788684043.122803:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085672960:0@lo:501: 10000000:01000000:3.0:1788684043.122831:0:6474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788684043.122847:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.122855:0:6474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684043.122862:0:6474:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d67466b4800 10000000:01000000:3.0:1788684043.122866:0:6474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788684043.122870:0:6474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d67466b4800 10000000:01000000:3.0:1788684043.122873:0:6474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788684043.122875:0:6474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d67466b4800 from 1 10000000:01000000:3.0:1788684043.122877:0:6474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788684043.122893:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000006808cf3f/0x44bac02bd54abe52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.122899:0:6474:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000006808cf3f/0x44bac02bd54abe52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.122932:0:6474:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000006808cf3f/0x44bac02bd54abe52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684043.122943:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673088:0@lo:101: 00000100:00100000:3.0:1788684043.122971:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684043.122990:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094299ace going to sleep for 11 seconds 00000100:00100000:0.0:1788684043.123112:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085673088 00000100:00100000:0.0:1788684043.123116:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085673088 00000100:00100000:0.0:1788684043.123135:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684043.123140:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066647a11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:6474:x1875571085673088:12345-0@lo:101: 00010000:00010000:0.0:1788684043.123147:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684043.123157:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032521955/0x44bac02bd54abe59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abe52 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.123171:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032521955/0x44bac02bd54abe59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abe52 expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.123179:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032521955/0x44bac02bd54abe59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abe52 expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.123185:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032521955, rc 0) 00000100:00100000:0.0:1788684043.123247:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066647a11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+7:6474:x1875571085673088:12345-0@lo:101: Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684043.123254:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788684043.123320:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673088:0@lo:101: 00010000:00010000:3.0:1788684043.123330:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000006808cf3f/0x44bac02bd54abe52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.123337:0:6474:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000006808cf3f/0x44bac02bd54abe52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684043.123347:0:6474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788684043.123350:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000006808cf3f/0x44bac02bd54abe52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.123356:0:6474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000006808cf3f/0x44bac02bd54abe52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684043.123361:0:6474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788684043.123393:0:6474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788684043.123398:0:6474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d67466b4800 10000000:01000000:3.0:1788684043.123400:0:6474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788684043.123403:0:6474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788684043.123405:0:6474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788684043.123417:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.123428:0:6474:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.123434:0:6474:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684043.123444:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673216:0@lo:101: 00000100:00100000:3.0:1788684043.123468:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684043.123486:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094299ace going to sleep for 11 seconds 00000100:00100000:0.0:1788684043.123556:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085673216 00000100:00100000:0.0:1788684043.123560:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085673216 00000100:00100000:0.0:1788684043.123576:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788684043.123581:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2da8b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+7:6474:x1875571085673216:12345-0@lo:101: 00010000:00010000:0.0:1788684043.123587:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684043.123594:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abe60 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.123605:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abe60 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.123612:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abe60 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.123618:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098454aae, rc 0) 00000100:00100000:0.0:1788684043.123653:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2da8b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+8:6474:x1875571085673216:12345-0@lo:101: Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684043.123658:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684043.123791:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673216:0@lo:101: 00010000:00010000:3.0:1788684043.123802:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.123809:0:6474:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684043.123851:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673344:0@lo:501: 00000100:00100000:3.0:1788684043.123874:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684043.123896:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094299ace going to sleep for 11 seconds 00000100:00100000:1.0:1788684043.124044:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085673344 00000100:00100000:1.0:1788684043.124049:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085673344 00000100:00100000:1.0:1788684043.124070:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788684043.124075:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e87dbf4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+8:6474:x1875571085673344:12345-0@lo:501: 00000100:00100000:1.0:1788684043.124176:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e87dbf4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:6474:x1875571085673344:12345-0@lo:501: Request processed in 101us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684043.124183:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788684043.124326:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673344:0@lo:501: 00000100:00100000:3.0:1788684043.124351:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673472:0@lo:503: 00000100:00100000:3.0:1788684043.124415:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684043.124431:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094299ace going to sleep for 11 seconds 00000100:00100000:1.0:1788684043.124521:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085673472 00000100:00100000:1.0:1788684043.124525:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085673472 00000100:00100000:1.0:1788684043.124552:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788684043.124557:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c679f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:6474:x1875571085673472:12345-0@lo:503: 00000100:00100000:1.0:1788684043.124625:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c679f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:6474:x1875571085673472:12345-0@lo:503: Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684043.124632:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788684043.124802:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673472:0@lo:503: 00000100:00100000:1.0:1788684043.125410:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d206bad2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6519:1875571085673600:0@lo:502: 00000100:00100000:1.0:1788684043.125450:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684043.125475:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000642ba025 going to sleep for 11 seconds 00000100:00100000:0.0:1788684043.125553:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085673600 00000100:00100000:0.0:1788684043.125558:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085673600 00000100:00100000:0.0:1788684043.125583:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684043.125590:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000207a2d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:6519:x1875571085673600:12345-0@lo:502: 00000100:00100000:0.0:1788684043.125689:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000207a2d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:6519:x1875571085673600:12345-0@lo:502: Request processed in 100us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684043.125696:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684043.125831:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d206bad2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6519:1875571085673600:0@lo:502: 00000020:01000000:3.0:1788684043.125861:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684043.125871:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684043.125874:0:6519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788684043.125878:0:6519:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788684043.125881:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684043.125893:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e00a8dec) 00000020:00000080:3.0:1788684043.125922:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788684043.125927:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788684043.125998:0:6519:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788684043.126005:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54abe75 00000020:00000080:3.0:1788684043.126215:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788684043.126220:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684043.126223:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684043.126225:0:6519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788684043.126227:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684043.126230:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684043.126231:0:6519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788684043.126234:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684043.126240:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001a9de13c) 00000020:00000080:3.0:1788684043.126248:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788684043.126252:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788684043.126253:0:6519:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788684043.126256:0:6519:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788684043.126262:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788684043.126302:0:6519:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000925b390 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788684043.126315:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a89882d2) 00000020:00000080:3.0:1788684043.126322:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788684043.126416:0:6519:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788684043.126422:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54abe8a 00000020:00000080:3.0:1788684043.126521:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788684043.126526:0:6519:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788684043.126531:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x44bac02bd54abe91 00080000:01000000:3.0:1788684043.126547:0:6519:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788684043.126555:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54abe98 00080000:10000000:3.0:1788684043.126928:0:6519:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788684043.127063:0:6519:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788684043.133481:0:6519:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788684043.260295:0:6519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788684043.260847:0:6519:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788684043.263762:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788684043.265491:0:6519:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788684043.272704:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000502c6b5) 00000020:00000080:2.0:1788684043.272725:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788684043.272809:0:6519:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788684043.272821:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54abea6 00000020:00000080:2.0:1788684043.278046:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788684043.279197:0:6519:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788684043.295903:0:6519:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788684043.307013:0:6519:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788684043.309849:0:6519:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788684043.312020:0:6519:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788684043.314027:0:6519:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788684043.315771:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x44bac02bd54abead 00000020:00000080:3.0:1788684043.316684:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788684043.316758:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684043.316827:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684043.316830:0:6519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788684043.316834:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684043.316840:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684043.316841:0:6519:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684043.316845:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684043.316846:0:6519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788684043.316849:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684043.316851:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684043.316852:0:6519:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788684043.316855:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684043.316859:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684043.316861:0:6519:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788684043.316864:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788684043.316959:0:6519:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788684043.317016:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6519:1875571085673728:0@lo:502: 00000100:00100000:3.0:1788684043.317099:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684043.317158:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094299ace going to sleep for 11 seconds 00000100:00100000:2.0:1788684043.317195:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085673728 00000100:00100000:2.0:1788684043.317211:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085673728 00000100:00100000:2.0:1788684043.317278:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684043.317290:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c27f90c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:6519:x1875571085673728:12345-0@lo:502: 00000100:00100000:2.0:1788684043.317517:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c27f90c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:6519:x1875571085673728:12345-0@lo:502: Request processed in 229us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684043.317526:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684043.318300:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ec1627 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6519:1875571085673728:0@lo:502: 00000020:01000000:3.0:1788684043.318383:0:6519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684043.318392:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684043.318394:0:6519:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788684043.318400:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788684043.318846:0:6474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788684043.318874:0:6474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788684043.319152:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684043.319164:0:6474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684043.319173:0:6474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d67466b4800 from 1 10000000:01000000:2.0:1788684043.319176:0:6474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788684043.319241:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684043.319248:0:6474:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684043.319259:0:6474:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684043.319280:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fe77bcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673856:0@lo:101: 00000100:00100000:2.0:1788684043.319355:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684043.319437:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fa743d5e going to sleep for 11 seconds 00000100:00100000:1.0:1788684043.321029:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085673856 00000100:00100000:1.0:1788684043.321059:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085673856 00000100:00100000:1.0:1788684043.321116:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788684043.321126:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b34626af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:6474:x1875571085673856:12345-0@lo:101: 00010000:00010000:1.0:1788684043.321143:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684043.321162:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abeb4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.321188:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abeb4 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.321198:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abeb4 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.321208:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004718e7de, rc 0) 00000100:00100000:1.0:1788684043.321355:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b34626af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:6474:x1875571085673856:12345-0@lo:101: Request processed in 231us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684043.321362:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684043.322358:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fe77bcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673856:0@lo:101: 00010000:00010000:0.0:1788684043.322415:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.322427:0:6474:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684043.323064:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673984:0@lo:256: 00000100:00100000:0.0:1788684043.323123:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684043.323174:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c60b470 going to sleep for 11 seconds 00000100:00100000:1.0:1788684043.323935:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085673984 00000100:00100000:1.0:1788684043.323943:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085673984 00000100:00100000:1.0:1788684043.323989:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788684043.323996:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c867f91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:6474:x1875571085673984:12345-0@lo:256: 20000000:01000000:1.0:1788684043.324016:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788684043.324022:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788684043.324113:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c867f91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:6474:x1875571085673984:12345-0@lo:256: Request processed in 117us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684043.324121:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684043.325811:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085673984:0@lo:256: 10000000:01000000:0.0:1788684043.327292:0:6474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684043.327433:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.327447:0:6474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684043.327457:0:6474:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67466b4800 from 1 10000000:01000000:0.0:1788684043.327460:0:6474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684043.327502:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.327510:0:6474:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.327518:0:6474:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684043.327538:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674112:0@lo:101: 00000100:00100000:0.0:1788684043.327610:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684043.327735:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c60b470 going to sleep for 11 seconds 00000100:00100000:2.0:1788684043.327777:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085674112 00000100:00100000:2.0:1788684043.327794:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085674112 00000100:00100000:2.0:1788684043.327876:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788684043.327887:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096179549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:6474:x1875571085674112:12345-0@lo:101: 00010000:00010000:2.0:1788684043.327907:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684043.327931:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abec2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684043.327963:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abec2 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684043.327976:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abec2 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684043.327987:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000363411d9, rc 0) 00000100:00100000:2.0:1788684043.328072:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096179549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:6474:x1875571085674112:12345-0@lo:101: Request processed in 187us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684043.328081:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684043.328140:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674112:0@lo:101: 00010000:00010000:0.0:1788684043.328160:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.328169:0:6474:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684043.328249:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674240:0@lo:501: 00000100:00100000:0.0:1788684043.328290:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684043.328333:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c60b470 going to sleep for 11 seconds 00000100:00100000:3.0:1788684043.328447:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085674240 00000100:00100000:3.0:1788684043.328455:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085674240 00000100:00100000:3.0:1788684043.328499:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788684043.328507:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8768b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:6474:x1875571085674240:12345-0@lo:501: 00000100:00100000:3.0:1788684043.328657:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8768b08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:6474:x1875571085674240:12345-0@lo:501: Request processed in 150us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684043.328665:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788684043.328785:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674240:0@lo:501: 00000100:00100000:0.0:1788684043.328811:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674368:0@lo:503: 00000100:00100000:0.0:1788684043.328852:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684043.328888:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c60b470 going to sleep for 11 seconds 00000100:00100000:1.0:1788684043.328958:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085674368 00000100:00100000:1.0:1788684043.328962:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085674368 00000100:00100000:1.0:1788684043.328996:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684043.329009:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006712ded1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:6474:x1875571085674368:12345-0@lo:503: 00000040:00080000:1.0:1788684043.329040:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788684043.329097:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006712ded1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:6474:x1875571085674368:12345-0@lo:503: Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684043.329104:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684043.329188:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674368:0@lo:503: 00000040:00080000:0.0:1788684043.330313:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788684043.330733:0:6474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788684043.330754:0:6474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788684043.330775:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.330786:0:6474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684043.330835:0:6474:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788684043.330839:0:6474:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d67466b4800 10000000:01000000:1.0:1788684043.330842:0:6474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d67466b4800 10000000:01000000:1.0:1788684043.330845:0:6474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788684043.330851:0:6474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67466b4800 from 1 10000000:01000000:1.0:1788684043.330853:0:6474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788684043.330883:0:6474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.330891:0:6474:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.330900:0:6474:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684043.330917:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9e13fce pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674496:0@lo:101: 00000100:00100000:1.0:1788684043.330968:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684043.331020:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d30c681 going to sleep for 11 seconds 00000100:00100000:3.0:1788684043.331090:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085674496 00000100:00100000:3.0:1788684043.331097:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085674496 00000100:00100000:3.0:1788684043.331139:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788684043.331147:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d202a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:6474:x1875571085674496:12345-0@lo:101: 00010000:00010000:3.0:1788684043.331158:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684043.331171:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abed0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.331190:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abed0 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.331200:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abed0 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.331219:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e91827b8, rc 0) 00000100:00100000:3.0:1788684043.331255:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d202a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6474:x1875571085674496:12345-0@lo:101: Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684043.331261:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684043.331900:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9e13fce pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674496:0@lo:101: 00010000:00010000:1.0:1788684043.331915:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.331924:0:6474:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684043.331976:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9e13fce pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674624:0@lo:501: 00000100:00100000:1.0:1788684043.332005:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684043.332031:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d30c681 going to sleep for 11 seconds 00000100:00100000:3.0:1788684043.332141:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085674624 00000100:00100000:3.0:1788684043.332147:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085674624 00000100:00100000:3.0:1788684043.332170:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788684043.332175:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000141eb1fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6474:x1875571085674624:12345-0@lo:501: 00000100:00100000:3.0:1788684043.332292:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000141eb1fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6474:x1875571085674624:12345-0@lo:501: Request processed in 117us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684043.332299:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684043.332485:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9e13fce pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674624:0@lo:501: 00000100:00100000:1.0:1788684043.332509:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9e13fce pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674752:0@lo:503: 00000100:00100000:1.0:1788684043.332550:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684043.332573:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d30c681 going to sleep for 11 seconds 00000100:00100000:3.0:1788684043.332707:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085674752 00000100:00100000:3.0:1788684043.332713:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085674752 00000100:00100000:3.0:1788684043.332734:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788684043.332739:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a096210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6474:x1875571085674752:12345-0@lo:503: 00000100:00100000:3.0:1788684043.332829:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a096210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6474:x1875571085674752:12345-0@lo:503: Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684043.332835:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788684043.332903:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9e13fce pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085674752:0@lo:503: 00000100:00100000:1.0:1788684043.333473:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000740f6211 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6524:1875571085674880:0@lo:502: 00000100:00100000:1.0:1788684043.333516:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684043.333532:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d30c681 going to sleep for 11 seconds 00000100:00100000:3.0:1788684043.333811:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085674880 00000100:00100000:3.0:1788684043.333817:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085674880 00000100:00100000:3.0:1788684043.333845:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788684043.333851:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009536a1de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6524:x1875571085674880:12345-0@lo:502: 00000100:00100000:3.0:1788684043.333958:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009536a1de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6524:x1875571085674880:12345-0@lo:502: Request processed in 107us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684043.333965:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788684043.334204:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000740f6211 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6524:1875571085674880:0@lo:502: 00000020:01000004:0.0:1788684043.334265:0:6524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788684043.334279:0:6524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a919d738) 00000020:00000080:0.0:1788684043.334297:0:6524:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788684043.335026:0:6524:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000925b390 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788684043.335032:0:6524:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000925b390 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788684043.335043:0:6524:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000925b390 4 00010000:00080000:0.0:1788684043.335209:0:6524:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c1ac6bbd@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1788684043.338098:0:6524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788684043.341592:0:6524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788684043.341639:0:6524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788684043.341653:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x44bac02bd54abee5 00000100:00080000:0.0:1788684043.341663:0:6524:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788684043.341680:0:6524:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c1ac6bbd using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684043.341719:0:6524:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ab2af5ba x1875571085675008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684043.341751:0:6524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788684043.345782:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085675008:0@lo:38: 00000100:00100000:3.0:1788684043.345890:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684043.345988:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085675008 00000100:00100000:0.0:1788684043.346005:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085675008 00000100:00100000:0.0:1788684043.346052:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684043.346059:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8ec1627 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085675008:12345-0@lo:38: 00000100:00100000:0.0:1788684043.346193:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8ec1627 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085675008:12345-0@lo:38: Request processed in 133us (303us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788684043.346201:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684043.346407:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085950dff pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6524:1875571085675136:0@lo:502: 00000100:00100000:0.0:1788684043.346473:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684043.346504:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085675136 00000100:00100000:0.0:1788684043.346508:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085675136 00000100:00100000:0.0:1788684043.346541:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788684043.346549:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053fc9b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6524:x1875571085675136:12345-0@lo:502: 00000100:00100000:3.0:1788684043.346609:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788684043.346618:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000c1ac6bbd lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684043.346622:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788684043.346626:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab2af5ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085675008:0@lo:38: 00000100:00100000:0.0:1788684043.346651:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053fc9b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6524:x1875571085675136:12345-0@lo:502: Request processed in 104us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684043.346657:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788684043.346714:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061fd48e6 going to sleep for 11 seconds 00000100:00100000:0.0:1788684043.346726:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085950dff pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6524:1875571085675136:0@lo:502: 00000040:00080000:0.0:1788684043.346748:0:6524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788684043.346900:0:6474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788684043.346924:0:6474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788684043.346975:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.346985:0:6474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788684043.347029:0:6474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788684043.347032:0:6474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788684043.347036:0:6474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684043.347037:0:6474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684043.347038:0:6474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684043.347039:0:6474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684043.347039:0:6474:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684043.347041:0:6474:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788684043.347042:0:6474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788684043.347043:0:6474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788684043.347044:0:6474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684043.347045:0:6474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684043.347049:0:6474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788684043.347052:0:6474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684043.347053:0:6474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788684043.347053:0:6474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684043.347054:0:6474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684043.347055:0:6474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684043.347056:0:6474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684043.347057:0:6474:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684043.347057:0:6474:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788684043.347058:0:6474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788684043.347059:0:6474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788684043.347060:0:6474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684043.347061:0:6474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684043.347074:0:6474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788684043.347084:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000522e28aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085675264:0@lo:253: 00000100:00100000:1.0:1788684043.347118:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684043.347147:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c8a5d2d going to sleep for 11 seconds 00000100:00100000:3.0:1788684043.347194:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085675264 00000100:00100000:3.0:1788684043.347199:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085675264 00000100:00100000:3.0:1788684043.347267:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684043.347274:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000daac2d76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6474:x1875571085675264:12345-0@lo:253: 20000000:01000000:3.0:1788684043.347299:0:6489:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788684043.347311:0:6489:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788684043.360277:0:6489:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788684043.360298:0:6489:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788684043.360529:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788684043.360534:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788684043.360555:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.360573:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abeb4 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.360581:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.360619:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abeb4 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684043.360631:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abeb4 expref: 12 pid: 6491 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684043.360645:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005dcb366 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085675392:0@lo:104: 00000100:00100000:3.0:1788684043.360721:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684043.360762:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da80508b going to sleep for 11 seconds 00000100:00100000:2.0:1788684043.360907:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085675392 00000100:00100000:2.0:1788684043.360914:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085675392 00000100:00100000:2.0:1788684043.361217:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684043.361226:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024b5f73a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6513:x1875571085675392:12345-0@lo:104: 00010000:00010000:2.0:1788684043.361239:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684043.361317:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788684043.361322:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024b5f73a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6513:x1875571085675392:12345-0@lo:104: Request processed in 99us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684043.361330:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788684043.361423:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684043.361429:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.361437:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d872597 already unused, calling callback (0000000028cfecd8) 10000000:00010000:1.0:1788684043.361440:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.361447:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684043.361463:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684043.361469:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684043.361508:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.361514:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684043.361547:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.361554:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 000000000d872597/0x44bac02bd54abeb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abebb expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684043.361568:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684043.361570:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684043.361571:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684043.361600:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000daac2d76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6474:x1875571085675264:12345-0@lo:253: Request processed in 14326us (14480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684043.361609:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788684043.361623:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684043.361631:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e744dbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085675520:0@lo:103: 00000100:00100000:1.0:1788684043.361659:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684043.361733:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005dcb366 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085675392:0@lo:104: 00010000:00010000:1.0:1788684043.361749:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684043.361776:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000522e28aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6474:1875571085675264:0@lo:253: 10000000:01000000:1.0:1788684043.361785:0:6474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788684043.361788:0:6474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788684043.361790:0:6474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788684043.361796:0:6474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684043.361798:0:6474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684043.361798:0:6474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684043.361799:0:6474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684043.361800:0:6474:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684043.361802:0:6474:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788684043.361803:0:6474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788684043.361804:0:6474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788684043.361805:0:6474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684043.361807:0:6474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788684043.361817:0:6474:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788684043.361909:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085675520 00000100:00100000:0.0:1788684043.361914:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085675520 00010000:00010000:0.0:1788684043.362050:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abeb4 expref: 12 pid: 6491 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684043.362076:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684043.362084:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aaf4c92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:3623:x1875571085675520:12345-0@lo:103: 00010000:00010000:0.0:1788684043.362094:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684043.362099:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abeb4 expref: 12 pid: 6491 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362108:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abeb4 expref: 12 pid: 6491 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362122:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004718e7de/0x44bac02bd54abebb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abeb4 expref: 12 pid: 6491 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362529:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362539:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788684043.362552:0:6482:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002019260s 00010000:00010000:0.0:1788684043.362563:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362569:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362576:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362582:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362587:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000023e81184 already unused, calling callback (0000000048a072f0) 00010000:00010000:0.0:1788684043.362590:0:6482:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362597:0:6482:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362612:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362622:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684043.362663:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aaf4c92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:3623:x1875571085675520:12345-0@lo:103: Request processed in 580us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684043.362681:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684043.362713:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e744dbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085675520:0@lo:103: 00010000:00010000:0.0:1788684043.362731:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362737:0:6513:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684043.362747:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000023e81184/0x44bac02bd54abeec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788684043.366793:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788684043.366962:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788684043.367167:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788684043.367336:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788684043.367544:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788684043.367704:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788684043.372698:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788684043.372980:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788684043.373179:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788684043.373336:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788684043.373914:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788684043.374063:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788684043.388954:0:6474:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788684043.401563:0:6474:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788684043.402764:0:6530:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788684043.404299:0:6474:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788684043.405936:0:6474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788684043.409634:0:6529:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788684043.409643:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:1.0:1788684043.409827:0:6474:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788684043.409843:0:6474:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788684043.410077:0:6474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684043.411422:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684043.413258:0:6474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788684043.414018:0:6474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788684043.414056:0:6474:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788684043.414331:0:6474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788684043.414580:0:6474:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788684043.420506:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788684043.420652:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788684043.420827:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788684043.420976:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788684043.421127:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788684043.421281:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788684043.421497:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788684043.421646:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788684043.421804:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788684043.421941:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788684043.422100:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788684043.422241:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788684043.426613:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000040:00080000:3.0:1788684043.428979:0:6530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:1.0:1788684043.428980:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000004:00080000:3.0:1788684043.429065:0:6530:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788684043.429069:0:6530:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1788684043.429241:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788684043.432835:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788684043.433253:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788684043.434070:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788684043.434293:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788684043.434627:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788684043.434857:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788684043.435013:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788684043.435220:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788684043.435355:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788684043.435552:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788684043.435782:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788684043.435915:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788684043.436039:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788684043.436182:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788684043.436333:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788684043.436549:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788684043.436704:0:6474:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788684043.436987:0:6474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788684043.443755:0:6474:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788684043.443806:0:6474:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb81ec19ab988 00100000:10000000:1.0:1788684043.443815:0:6474:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788684043.444638:0:6474:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788684043.444665:0:6474:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788684043.444694:0:6474:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788684043.444732:0:6474:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788684043.445332:0:6474:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684043.445500:0:6474:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788684043.909309:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684044.925541:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684045.958051:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684046.982736:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788684047.809221:0:6775:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788684047.998676:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788684048.512478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788684048.512492:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788684048.512496:0:8:0:(import.c:65:import_set_state_nolock()) 00000000c1ac6bbd lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684048.512515:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c1ac6bbd using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684048.512545:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000007ca3a99 x1875571085675776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684048.512585:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007ca3a99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085675776:0@lo:38: 00000100:00100000:3.0:1788684048.512823:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684048.512849:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000522e28aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085675648:0@lo:400: 00000100:00100000:3.0:1788684048.512968:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684048.513065:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085675648 00000100:00100000:3.0:1788684048.513077:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085675648 00000100:00100000:3.0:1788684048.513137:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684048.513147:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9530e62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:3626:x1875571085675648:12345-0@lo:400: 00000100:00100000:3.0:1788684048.513215:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9530e62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:3626:x1875571085675648:12345-0@lo:400: Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684048.513223:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684048.513300:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000522e28aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085675648:0@lo:400: 00000100:00100000:1.0:1788684048.514458:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684048.515042:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085675776 00000100:00100000:3.0:1788684048.515052:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085675776 00000100:00100000:3.0:1788684048.515098:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684048.515107:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c56038b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1875571085675776:12345-0@lo:38: 00010000:00080000:3.0:1788684048.515141:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:3.0:1788684048.515188:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x44bac02bd54abef3 00000004:00100000:3.0:1788684048.519184:0:6499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788684048.519443:0:6499:0:(import.c:65:import_set_state_nolock()) 0000000023577f7a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684048.519581:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c56038b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875571085675776:12345-0@lo:38: Request processed in 4472us (5126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684048.519614:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788684048.520233:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000007ca3a99 x1875571085675776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788684048.520256:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788684048.520279:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788684048.520286:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788684048.520289:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000c1ac6bbd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788684048.520297:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007ca3a99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085675776:0@lo:38: 00000020:00000004:3.0:1788684048.890663:0:6827:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684048.890830:0:6827:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684049.027747:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788684049.534458:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684049.534470:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d67466b4800 from 3 10000000:01000000:0.0:1788684049.534477:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684049.534542:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684049.534558:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684049.534571:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684049.534602:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085950dff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085675904:0@lo:101: 00000100:00100000:0.0:1788684049.534711:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684049.534783:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000124a72a3 going to sleep for 11 seconds 00000100:00100000:2.0:1788684049.535350:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085675904 00000100:00100000:2.0:1788684049.535363:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085675904 00000100:00100000:2.0:1788684049.535439:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788684049.535449:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076bffbaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:6495:x1875571085675904:12345-0@lo:101: 00010000:00010000:2.0:1788684049.535465:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684049.535482:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abefa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684049.535513:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abefa expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684049.535523:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abefa expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684049.535554:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000014833d4e, rc 0) 00000100:00100000:2.0:1788684049.535641:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076bffbaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6495:x1875571085675904:12345-0@lo:101: Request processed in 178us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684049.535649:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788684049.535752:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085950dff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085675904:0@lo:101: 00010000:00010000:1.0:1788684049.535781:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684049.535791:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684049.535863:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007ca3a99 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085676032:0@lo:256: 00000100:00100000:1.0:1788684049.535908:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684049.535946:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a66a3769 going to sleep for 11 seconds 00000100:00100000:2.0:1788684049.536064:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085676032 00000100:00100000:2.0:1788684049.536069:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085676032 00000100:00100000:2.0:1788684049.536105:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788684049.536111:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7381d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6495:x1875571085676032:12345-0@lo:256: 20000000:01000000:2.0:1788684049.536126:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788684049.536144:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788684049.536148:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788684049.536252:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7381d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6495:x1875571085676032:12345-0@lo:256: Request processed in 140us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684049.536260:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788684049.536295:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007ca3a99 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085676032:0@lo:256: 10000000:01000000:2.0:1788684049.536341:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788684049.536347:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684049.536355:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684050.045922:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684051.069705:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788684051.847419:0:6929:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684051.847580:0:6929:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788684052.094609:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684053.118427:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684053.629644:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684053.629661:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3b4f4aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085676160:0@lo:400: 00000100:00100000:1.0:1788684053.629733:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039379c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085676288:0@lo:400: 00000100:00100000:2.0:1788684053.629744:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684053.629765:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684053.629817:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085676288 00000100:00100000:2.0:1788684053.629835:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085676288 00000100:00100000:0.0:1788684053.629876:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085676160 00000100:00100000:2.0:1788684053.629886:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684053.629893:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003604a150 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085676288:12345-0@lo:400: 00000100:00100000:2.0:1788684053.629939:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003604a150 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085676288:12345-0@lo:400: Request processed in 47us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684053.629946:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788684053.629971:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000039379c97 x1875571085676288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684053.629985:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039379c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085676288:0@lo:400: 00000100:00100000:0.0:1788684053.630034:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085676160 00000100:00100000:0.0:1788684053.630071:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788684053.630076:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006394fd30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:3625:x1875571085676160:12345-0@lo:400: 00000100:00100000:0.0:1788684053.630122:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006394fd30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:3625:x1875571085676160:12345-0@lo:400: Request processed in 46us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684053.630129:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788684053.630174:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3b4f4aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085676160:0@lo:400: 00010000:00010000:3.0:1788684054.145042:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684055.167640:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684056.192220:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684057.218503:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684058.238762:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684058.751993:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684058.752024:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039379c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085676416:0@lo:400: 00000100:00100000:1.0:1788684058.752180:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684058.752258:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085676416 00000100:00100000:1.0:1788684058.752268:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085676416 00000100:00100000:1.0:1788684058.754443:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788684058.754471:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ccb0d71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:3623:x1875571085676416:12345-0@lo:400: 00000100:00100000:1.0:1788684058.754596:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ccb0d71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:3623:x1875571085676416:12345-0@lo:400: Request processed in 138us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684058.754616:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788684058.756523:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ffd07c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085676544:0@lo:400: 00000100:00100000:1.0:1788684058.756626:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684058.757073:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039379c97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085676416:0@lo:400: 00000100:00100000:0.0:1788684058.760256:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085676544 00000100:00100000:0.0:1788684058.760289:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085676544 00000100:00100000:0.0:1788684058.760384:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788684058.760394:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cd3d7e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085676544:12345-0@lo:400: 00000100:00100000:0.0:1788684058.760512:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cd3d7e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085676544:12345-0@lo:400: Request processed in 120us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684058.760519:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788684058.761319:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e8ffd07c x1875571085676544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684058.761339:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ffd07c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085676544:0@lo:400: 00010000:00010000:1.0:1788684059.261965:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684060.285842:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788684060.528766:0:7427:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788684060.528770:0:7427:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788684060.528772:0:7427:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788684060.528913:0:7427:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003d509353 00000020:01000004:2.0:1788684060.528929:0:7427:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788684060.528940:0:7427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788684060.528964:0:7427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000006cb1fa73) 00000020:00000080:2.0:1788684060.528989:0:7427:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788684060.602026:0:7427:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788684060.602112:0:7427:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788684060.622994:0:7427:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788684060.623422:0:7427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788684060.623437:0:7427:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788684060.623453:0:7427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54abf0f 00000020:01000004:2.0:1788684060.623462:0:7427:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788684060.623489:0:7427:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788684060.623493:0:7427:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788684060.623500:0:7427:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788684060.623556:0:7427:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788684060.623570:0:7427:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788684060.665197:0:7427:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788684060.665275:0:7427:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788684060.665279:0:7427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788684060.665281:0:7427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684060.665282:0:7427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684060.665284:0:7427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684060.665285:0:7427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684060.665286:0:7427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684060.665287:0:7427:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684060.665288:0:7427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788684060.665289:0:7427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788684060.665290:0:7427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684060.665291:0:7427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684060.665295:0:7427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788684060.665297:0:7427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684060.665298:0:7427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684060.665299:0:7427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684060.665300:0:7427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684060.665301:0:7427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684060.665302:0:7427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684060.665303:0:7427:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684060.665304:0:7427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788684060.665305:0:7427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788684060.665306:0:7427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684060.665307:0:7427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684060.665342:0:7427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788684060.665360:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8ffd07c pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085676672:0@lo:253: 00000100:00100000:2.0:1788684060.665941:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.666011:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055a27119 going to sleep for 11 seconds 00000100:00100000:1.0:1788684060.669259:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085676672 00000100:00100000:1.0:1788684060.669276:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085676672 00000100:00100000:1.0:1788684060.669351:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788684060.669360:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006603a0be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085676672:12345-0@lo:253: 20000000:01000000:0.0:1788684060.669662:0:6491:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788684060.669669:0:6491:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788684060.669673:0:6491:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788684060.669676:0:6491:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788684060.669723:0:6491:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788684060.669992:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684060.670190:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788684060.670214:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788684060.670235:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788684060.670252:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788684060.670268:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788684060.670326:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788684060.670334:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788684060.670347:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788684060.670351:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788684060.670362:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788684060.670517:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788684060.670537:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788684060.670569:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788684060.670695:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788684060.670714:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:0.0:1788684060.670733:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788684060.670743:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788684060.670758:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788684060.670776:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:0.0:1788684060.670793:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788684060.670800:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788684060.670816:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788684060.670835:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788684060.670847:0:6491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788684060.670935:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788684060.670947:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788684060.670962:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788684060.670980:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788684060.670999:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788684060.671006:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788684060.671021:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788684060.671043:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788684060.671050:0:6491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788684060.671075:0:6491:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788684060.671081:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788684060.673179:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788684060.673677:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788684060.673721:0:6491:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.144@tcp for mdt 20000000:01000000:2.0:1788684060.673755:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:2.0:1788684060.673787:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788684060.673802:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788684060.673821:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788684060.673828:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:2.0:1788684060.673847:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788684060.673857:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788684060.673872:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788684060.673891:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788684060.673959:0:6491:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788684060.673969:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788684060.676808:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788684060.677117:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788684060.677142:0:6491:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.144@tcp for mdt 20000000:01000000:2.0:1788684060.677145:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:2.0:1788684060.677161:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788684060.677166:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788684060.677179:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788684060.677183:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:2.0:1788684060.677195:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788684060.677202:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788684060.677227:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788684060.677243:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788684060.677265:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788684060.677268:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788684060.677273:0:6491:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788684060.677315:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788684060.677318:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788684060.679115:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788684060.679234:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788684060.679251:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788684060.679501:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788684060.679528:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788684060.679547:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788684060.679558:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788684060.679569:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788684060.679925:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788684060.679945:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788684060.679959:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788684060.680146:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788684060.680165:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788684060.680197:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788684060.680284:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788684060.680286:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788684060.680612:0:7437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788684060.680632:0:7437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788684060.680647:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788684060.680770:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788684060.680785:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788684060.680803:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788684060.680813:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788684060.680815:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788684060.680819:0:6491:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788684060.680826:0:6491:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788684060.681120:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788684060.681291:0:6491:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788684060.696434:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788684060.699056:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.699077:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abe44 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.699084:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abe60 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.699089:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abed0 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.699095:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.699215:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abed0 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.699229:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abed0 expref: 12 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684060.699260:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a416d17a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6491:1875571085676800:0@lo:104: 00000100:00100000:3.0:1788684060.699321:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684060.699408:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abe60 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.699416:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abe60 expref: 12 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684060.699423:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056316226 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6491:1875571085676928:0@lo:104: 00000100:00100000:3.0:1788684060.699462:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684060.699494:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abe44 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.699501:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abe44 expref: 12 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684060.699508:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096798eb9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6491:1875571085677056:0@lo:104: 00000100:00100000:3.0:1788684060.699528:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684060.699530:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085676800 00000100:00100000:3.0:1788684060.699539:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cb081fe going to sleep for 11 seconds 00000100:00100000:1.0:1788684060.699539:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085676800 00000100:00100000:1.0:1788684060.699585:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085676928 00000100:00100000:1.0:1788684060.699588:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085676928 00000100:00100000:1.0:1788684060.699605:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085677056 00000100:00100000:1.0:1788684060.699608:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085677056 00000100:00100000:1.0:1788684060.699620:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684060.699626:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfdc466f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:6491:x1875571085676800:12345-0@lo:104: 00010000:00010000:1.0:1788684060.699638:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699701:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788684060.699706:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfdc466f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:6491:x1875571085676800:12345-0@lo:104: Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.699712:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684060.699728:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684060.699733:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c243730 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6491:x1875571085676928:12345-0@lo:104: 00010000:00010000:1.0:1788684060.699739:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699770:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788684060.699774:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c243730 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6491:x1875571085676928:12345-0@lo:104: Request processed in 43us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.699788:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684060.699800:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788684060.699804:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c989f3b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6491:x1875571085677056:12345-0@lo:104: 00010000:00010000:1.0:1788684060.699811:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699837:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788684060.699841:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c989f3b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6491:x1875571085677056:12345-0@lo:104: Request processed in 37us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.699846:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788684060.699860:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788684060.699864:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699871:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c5c6dd1e already unused, calling callback (0000000028cfecd8) 10000000:00010000:1.0:1788684060.699875:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699883:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684060.699889:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684060.699895:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684060.699922:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699929:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684060.699949:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699955:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 00000000c5c6dd1e/0x44bac02bd54abed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abed7 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699969:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684060.699971:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699977:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c953c104 already unused, calling callback (0000000028cfecd8) 10000000:00010000:1.0:1788684060.699979:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.699985:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684060.699990:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684060.699995:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684060.700005:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700010:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684060.700021:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700027:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 00000000c953c104/0x44bac02bd54abe60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abe67 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700035:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684060.700041:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700046:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000051e8a128 already unused, calling callback (0000000028cfecd8) 10000000:00010000:1.0:1788684060.700048:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700054:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684060.700059:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684060.700064:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684060.700073:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700079:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684060.700082:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700087:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 0000000051e8a128/0x44bac02bd54abe44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abe4b expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700098:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684060.700100:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684060.700101:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684060.700107:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684060.700123:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000286e3e18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085677184:0@lo:103: 00000100:00100000:1.0:1788684060.700152:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684060.700185:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099047ef4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085677312:0@lo:103: 00000100:00100000:1.0:1788684060.700399:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684060.700419:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684060.700425:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9d5f837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085677440:0@lo:103: 00000100:00100000:1.0:1788684060.700459:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684060.700496:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085677184 00000100:00100000:1.0:1788684060.700499:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085677184 00000100:00100000:3.0:1788684060.700506:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a416d17a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6491:1875571085676800:0@lo:104: 00000100:00100000:3.0:1788684060.700515:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056316226 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6491:1875571085676928:0@lo:104: 00010000:00010000:1.0:1788684060.700516:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abed0 expref: 13 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684060.700521:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096798eb9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6491:1875571085677056:0@lo:104: 00000100:00100000:1.0:1788684060.700530:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085677312 00000100:00100000:1.0:1788684060.700532:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085677312 00010000:00010000:1.0:1788684060.700539:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abe60 expref: 14 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.700542:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684060.700547:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085677440 00000100:00100000:1.0:1788684060.700549:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085677440 00010000:00010000:1.0:1788684060.700570:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abe44 expref: 15 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684060.700597:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684060.700603:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053d29ca4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3626:x1875571085677184:12345-0@lo:103: 00010000:00010000:1.0:1788684060.700614:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684060.700618:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abed0 expref: 15 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700628:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abed0 expref: 15 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700640:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e91827b8/0x44bac02bd54abed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abed0 expref: 15 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700661:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684060.700697:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053d29ca4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:3626:x1875571085677184:12345-0@lo:103: Request processed in 95us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.700704:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684060.700717:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684060.700723:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdf387d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:3623:x1875571085677312:12345-0@lo:103: 00010000:00010000:1.0:1788684060.700730:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684060.700734:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abe60 expref: 13 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700741:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abe60 expref: 13 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700749:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098454aae/0x44bac02bd54abe67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abe60 expref: 13 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700758:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684060.700783:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdf387d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:3623:x1875571085677312:12345-0@lo:103: Request processed in 61us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.700789:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684060.700800:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788684060.700805:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039379c97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:3623:x1875571085677440:12345-0@lo:103: 00010000:00010000:1.0:1788684060.700813:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684060.700816:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abe44 expref: 11 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700824:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abe44 expref: 11 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700840:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abe4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abe44 expref: 11 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700851:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700859:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700871:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700878:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700884:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700890:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700896:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c21f6306 already unused, calling callback (0000000048a072f0) 00010000:00010000:1.0:1788684060.700899:0:6484:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700904:0:6484:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700917:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.700937:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684060.700958:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039379c97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:3623:x1875571085677440:12345-0@lo:103: Request processed in 153us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.700964:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788684060.700987:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9d5f837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085677440:0@lo:103: 00000100:00100000:1.0:1788684060.700994:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099047ef4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085677312:0@lo:103: 00010000:00010000:1.0:1788684060.701009:0:6491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.701015:0:6491:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.701020:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c21f6306/0x44bac02bd54abf16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788684060.701035:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788684060.701041:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000286e3e18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085677184:0@lo:103: 00000100:00100000:1.0:1788684060.706952:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006603a0be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:7427:x1875571085676672:12345-0@lo:253: Request processed in 37586us (41011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.706967:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684060.707071:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8ffd07c pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085676672:0@lo:253: 10000000:01000000:2.0:1788684060.707088:0:7427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788684060.707091:0:7427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788684060.707093:0:7427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788684060.707094:0:7427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788684060.707096:0:7427:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788684060.707097:0:7427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788684060.707098:0:7427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788684060.707099:0:7427:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788684060.707101:0:7427:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788684060.707102:0:7427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788684060.707103:0:7427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788684060.707125:0:7427:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003d509353 from lustre-MDT0001 10000000:01000000:2.0:1788684060.707153:0:7427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788684060.707156:0:7427:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788684060.707162:0:7427:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d67482e3380 local copy 10000000:01000000:2.0:1788684060.707166:0:7427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788684060.707226:0:7427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.707237:0:7427:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.707245:0:7427:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.707263:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085677568:0@lo:101: 00000100:00100000:2.0:1788684060.707299:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.707336:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc8154ac going to sleep for 11 seconds 00000100:00100000:0.0:1788684060.707518:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085677568 00000100:00100000:0.0:1788684060.707530:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085677568 00000100:00100000:0.0:1788684060.707586:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788684060.707595:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086a2e9b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:7427:x1875571085677568:12345-0@lo:101: 00010000:00010000:0.0:1788684060.707608:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684060.707620:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9b098c1/0x44bac02bd54abf24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abf1d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684060.707641:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9b098c1/0x44bac02bd54abf24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abf1d expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684060.707650:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9b098c1/0x44bac02bd54abf24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abf1d expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684060.707658:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9b098c1, rc 0) 00000100:00100000:0.0:1788684060.707687:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086a2e9b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:7427:x1875571085677568:12345-0@lo:101: Request processed in 94us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684060.707693:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684060.707966:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085677568:0@lo:101: 00010000:00010000:2.0:1788684060.707980:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.707988:0:7427:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.708075:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085677696:0@lo:501: 00000100:00100000:2.0:1788684060.708100:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.708127:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc8154ac going to sleep for 11 seconds 00000100:00100000:1.0:1788684060.708177:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085677696 00000100:00100000:1.0:1788684060.708181:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085677696 00000100:00100000:1.0:1788684060.708221:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788684060.708228:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ef61de9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:7427:x1875571085677696:12345-0@lo:501: 00000100:00100000:1.0:1788684060.708289:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ef61de9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:7427:x1875571085677696:12345-0@lo:501: Request processed in 62us (189us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788684060.708296:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684060.708426:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085677696:0@lo:501: 10000000:01000000:2.0:1788684060.708450:0:7427:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788684060.708467:0:7427:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788684060.708471:0:7427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.708479:0:7427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.708493:0:7427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.708509:0:7427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788684060.708532:0:7427:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d677cc6f800 10000000:01000000:2.0:1788684060.708537:0:7427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788684060.708542:0:7427:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d67482e3380 10000000:01000000:2.0:1788684060.708543:0:7427:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788684060.708546:0:7427:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d67482e3380 from 1 10000000:01000000:2.0:1788684060.708548:0:7427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788684060.708564:0:7427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000c6212407/0x44bac02bd54abf2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.708571:0:7427:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000c6212407/0x44bac02bd54abf2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.708591:0:7427:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000c6212407/0x44bac02bd54abf2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.708603:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085677824:0@lo:101: 00000100:00100000:2.0:1788684060.708630:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.708649:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019ccf4fa going to sleep for 11 seconds 00010000:00010000:1.0:1788684060.708827:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684060.708837:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.708845:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f7bff8d already unused, calling callback (0000000028cfecd8) 10000000:00010000:1.0:1788684060.708847:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.708854:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684060.708860:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684060.708865:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684060.708882:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.708889:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684060.708905:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.708912:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 000000005f7bff8d/0x44bac02bd54abf1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x44bac02bd54abf24 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.708926:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684060.708928:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684060.708929:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684060.708938:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085677824 00000100:00100000:1.0:1788684060.708942:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085677824 00000100:00100000:1.0:1788684060.708965:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684060.708970:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067eb6024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:7427:x1875571085677824:12345-0@lo:101: 00010000:00010000:1.0:1788684060.708985:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684060.708994:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004426cfcb/0x44bac02bd54abf32 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abf2b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.709009:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004426cfcb/0x44bac02bd54abf32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abf2b expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.709016:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004426cfcb/0x44bac02bd54abf32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abf2b expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.709023:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004426cfcb, rc 0) 00000100:00100000:1.0:1788684060.709049:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067eb6024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:7427:x1875571085677824:12345-0@lo:101: Request processed in 79us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.709054:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684060.709074:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684060.709083:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099047ef4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085677952:0@lo:103: 00000100:00100000:1.0:1788684060.709106:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684060.709130:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085677952 00000100:00100000:1.0:1788684060.709134:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085677952 00000100:00100000:1.0:1788684060.709158:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684060.709164:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d5f837 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:3626:x1875571085677952:12345-0@lo:103: 00010000:00010000:1.0:1788684060.709172:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684060.709183:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d9b098c1/0x44bac02bd54abf24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54abf1d expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.709194:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684060.709328:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d5f837 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:3626:x1875571085677952:12345-0@lo:103: Request processed in 163us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.709334:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684060.709383:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099047ef4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085677952:0@lo:103: 00000100:00100000:2.0:1788684060.709594:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085677824:0@lo:101: 00010000:00010000:2.0:1788684060.709606:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000c6212407/0x44bac02bd54abf2b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf32 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.709614:0:7427:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000c6212407/0x44bac02bd54abf2b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abf32 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684060.709642:0:7427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788684060.709659:0:7427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000c6212407/0x44bac02bd54abf2b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf32 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.709666:0:7427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000c6212407/0x44bac02bd54abf2b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf32 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684060.709675:0:7427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d677cc6f800 10000000:01000000:2.0:1788684060.709680:0:7427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788684060.709683:0:7427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d677cc6f800 from 1 10000000:01000000:2.0:1788684060.709685:0:7427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788684060.709699:0:7427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000006997eb11/0x44bac02bd54abf39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.709706:0:7427:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000006997eb11/0x44bac02bd54abf39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.709713:0:7427:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000006997eb11/0x44bac02bd54abf39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.709725:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678080:0@lo:101: 00000100:00100000:2.0:1788684060.709750:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.709779:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019ccf4fa going to sleep for 11 seconds 00000100:00100000:0.0:1788684060.709831:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085678080 00000100:00100000:0.0:1788684060.709836:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085678080 00000100:00100000:0.0:1788684060.709872:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788684060.709880:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca1f8555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+10:7427:x1875571085678080:12345-0@lo:101: 00010000:00010000:0.0:1788684060.709887:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684060.709894:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ceb3faf/0x44bac02bd54abf40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abf39 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684060.709907:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ceb3faf/0x44bac02bd54abf40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abf39 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684060.709913:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ceb3faf/0x44bac02bd54abf40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abf39 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684060.709929:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ceb3faf, rc 0) 00000100:00100000:0.0:1788684060.709958:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca1f8555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:7427:x1875571085678080:12345-0@lo:101: Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684060.709963:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788684060.710033:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678080:0@lo:101: 00010000:00010000:2.0:1788684060.710044:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000006997eb11/0x44bac02bd54abf39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.710051:0:7427:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000006997eb11/0x44bac02bd54abf39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684060.710069:0:7427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788684060.710072:0:7427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000006997eb11/0x44bac02bd54abf39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.710077:0:7427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000006997eb11/0x44bac02bd54abf39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684060.710082:0:7427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788684060.710085:0:7427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788684060.710089:0:7427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d677cc6f800 10000000:01000000:2.0:1788684060.710091:0:7427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788684060.710093:0:7427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788684060.710095:0:7427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788684060.710107:0:7427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000bb7646b6/0x44bac02bd54abf47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.710113:0:7427:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000bb7646b6/0x44bac02bd54abf47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.710120:0:7427:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000bb7646b6/0x44bac02bd54abf47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.710130:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678208:0@lo:101: 00000100:00100000:2.0:1788684060.710154:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.710173:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019ccf4fa going to sleep for 11 seconds 00000100:00100000:2.0:1788684060.710187:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085678208 00000100:00100000:2.0:1788684060.710191:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085678208 00000100:00100000:2.0:1788684060.710344:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788684060.710352:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f4117b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:7427:x1875571085678208:12345-0@lo:101: 00010000:00010000:2.0:1788684060.710389:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684060.710399:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004f54409/0x44bac02bd54abf4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abf47 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.710413:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004f54409/0x44bac02bd54abf4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abf47 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.710420:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004f54409/0x44bac02bd54abf4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abf47 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.710426:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004f54409, rc 0) 00000100:00100000:2.0:1788684060.710537:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f4117b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085678208:12345-0@lo:101: Request processed in 187us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684060.710544:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788684060.710595:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678208:0@lo:101: 00010000:00010000:2.0:1788684060.710604:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000bb7646b6/0x44bac02bd54abf47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.710611:0:7427:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000bb7646b6/0x44bac02bd54abf47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.710685:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678336:0@lo:501: 00000100:00100000:2.0:1788684060.710711:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.710724:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019ccf4fa going to sleep for 11 seconds 00000100:00100000:2.0:1788684060.710736:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085678336 00000100:00100000:2.0:1788684060.710740:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085678336 00000100:00100000:2.0:1788684060.710756:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788684060.710761:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085678336:12345-0@lo:501: 00000100:00100000:2.0:1788684060.710854:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085678336:12345-0@lo:501: Request processed in 93us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684060.710861:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788684060.710890:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678336:0@lo:501: 00000100:00100000:2.0:1788684060.710913:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678464:0@lo:503: 00000100:00100000:2.0:1788684060.710949:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.710961:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019ccf4fa going to sleep for 11 seconds 00000100:00100000:2.0:1788684060.710974:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085678464 00000100:00100000:2.0:1788684060.710977:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085678464 00000100:00100000:2.0:1788684060.710992:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788684060.710996:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8c39419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085678464:12345-0@lo:503: 00000100:00100000:2.0:1788684060.711076:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8c39419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085678464:12345-0@lo:503: Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684060.711083:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788684060.711121:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678464:0@lo:503: 00000040:00080000:2.0:1788684060.711697:0:7427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788684060.711760:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678592:0@lo:502: 00000100:00100000:2.0:1788684060.711801:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.711873:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019ccf4fa going to sleep for 11 seconds 00000100:00100000:0.0:1788684060.711996:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085678592 00000100:00100000:0.0:1788684060.712001:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085678592 00000100:00100000:0.0:1788684060.712081:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684060.712090:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b5df89f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085678592:12345-0@lo:502: 00000100:00100000:0.0:1788684060.712179:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b5df89f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085678592:12345-0@lo:502: Request processed in 91us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684060.712186:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788684060.712310:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec7bf00d pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678592:0@lo:502: 00000040:00080000:3.0:1788684060.712558:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788684060.712596:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788684060.712612:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788684060.712626:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788684060.712639:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788684060.712651:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788684060.712662:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788684060.712674:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788684060.712688:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788684060.712701:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788684060.712713:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788684060.712726:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788684060.712739:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788684060.712753:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788684060.712766:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788684060.712779:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788684060.712792:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788684060.712806:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788684060.712820:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788684060.712836:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788684060.712850:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788684060.712866:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788684060.712880:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788684060.712903:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096798eb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678720:0@lo:502: 00000100:00100000:3.0:1788684060.712948:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.713640:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cb081fe going to sleep for 11 seconds 00000100:00100000:2.0:1788684060.713810:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085678720 00000100:00100000:2.0:1788684060.713818:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085678720 00000100:00100000:2.0:1788684060.713851:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788684060.713857:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cfe7878 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085678720:12345-0@lo:502: 00000100:00100000:2.0:1788684060.713987:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cfe7878 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085678720:12345-0@lo:502: Request processed in 129us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684060.714003:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788684060.714108:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096798eb9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085678720:0@lo:502: 00000040:00080000:3.0:1788684060.714171:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788684060.714182:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788684060.714847:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684060.714858:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684060.714860:0:7439:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788684060.714866:0:7439:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788684060.714869:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684060.714889:0:7439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000004c2757bb) 00000020:00000080:3.0:1788684060.714909:0:7439:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788684060.714916:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788684060.714991:0:7439:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788684060.714997:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54abf5c 00000020:00000080:3.0:1788684060.715185:0:7439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788684060.715189:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684060.715192:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684060.715194:0:7439:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788684060.715196:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684060.715199:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684060.715200:0:7439:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788684060.715203:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684060.715223:0:7439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000005792e11c) 00000020:00000080:3.0:1788684060.715232:0:7439:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788684060.715236:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788684060.715237:0:7439:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788684060.715240:0:7439:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788684060.715245:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788684060.715283:0:7439:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003d509353 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788684060.715293:0:7439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000809b1d30) 00000020:00000080:3.0:1788684060.715300:0:7439:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788684060.715362:0:7439:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788684060.715401:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54abf71 00000020:00000080:3.0:1788684060.715501:0:7439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788684060.715508:0:7439:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788684060.715511:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x44bac02bd54abf78 00080000:01000000:3.0:1788684060.715516:0:7439:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788684060.715524:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54abf7f 00080000:10000000:3.0:1788684060.715940:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788684060.716060:0:7439:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788684060.798060:0:7439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788684060.799637:0:7439:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788684060.801613:0:7439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788684060.801891:0:7439:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788684060.826099:0:7439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788684060.826113:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684060.826119:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684060.826121:0:7439:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788684060.826125:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684060.826131:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684060.826133:0:7439:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788684060.826135:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788684060.826140:0:7439:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:2.0:1788684060.826167:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684060.826182:0:7439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000f4234041) 00000020:00000080:2.0:1788684060.826202:0:7439:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788684060.826217:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788684060.826304:0:7439:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788684060.826310:0:7439:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788684060.826316:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54abf8d 00010000:00080000:2.0:1788684060.826344:0:7439:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004d8195a6@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684060.835419:0:7439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788684060.836543:0:7439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788684060.836560:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788684060.836607:0:7439:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788684060.836630:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54abf94 00000100:00080000:1.0:1788684060.836641:0:7439:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788684060.836646:0:7439:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000004d8195a6 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684060.836681:0:7439:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000099047ef4 x1875571085678848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788684060.836699:0:7439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788684060.836752:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684060.836756:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684060.836758:0:7439:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788684060.836760:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788684060.836763:0:7439:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788684060.836765:0:7439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788684060.836767:0:7439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788684060.836768:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788684060.836771:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684060.836772:0:7439:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788684060.836774:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684060.836779:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684060.836780:0:7439:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788684060.836783:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788684060.836809:0:7439:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788684060.836822:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684060.836825:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684060.836826:0:7439:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788684060.836829:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684060.836831:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684060.836832:0:7439:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788684060.836839:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788684060.836841:0:7439:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788684060.836866:0:7439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684060.836869:0:7439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684060.836870:0:7439:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788684060.836873:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1788684060.837297:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099047ef4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085678848:0@lo:38: 00000100:00100000:3.0:1788684060.837358:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.837810:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abb1384b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085678976:0@lo:400: 00000100:00100000:1.0:1788684060.837822:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085678848 00000100:00100000:1.0:1788684060.837829:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085678848 00000100:00100000:3.0:1788684060.837842:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684060.837858:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684060.837865:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096798eb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085678848:12345-0@lo:38: 00010000:00080000:1.0:1788684060.837893:0:6502:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 141 last 0 00000020:00000080:1.0:1788684060.837975:0:6502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54abf9b 00000004:00100000:1.0:1788684060.837990:0:6502:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788684060.837995:0:6502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1788684060.838313:0:7427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788684060.838354:0:7427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788684060.838391:0:7427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000bb7646b6/0x44bac02bd54abf47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.838402:0:7427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000bb7646b6/0x44bac02bd54abf47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684060.838417:0:7427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d677cc6f800 from 1 10000000:01000000:2.0:1788684060.838420:0:7427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788684060.838456:0:7427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.838463:0:7427:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.838472:0:7427:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.838486:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c0ac019f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679104:0@lo:101: 00000100:00100000:2.0:1788684060.838522:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.838556:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 000000006133333a going to sleep for 11 seconds 00000100:00100000:2.0:1788684060.838586:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085678976 00000100:00100000:2.0:1788684060.838590:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085678976 00000100:00100000:2.0:1788684060.838626:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684060.838632:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056316226 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085678976:12345-0@lo:400: 00000100:00100000:1.0:1788684060.839901:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085679104 00000100:00100000:1.0:1788684060.839911:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085679104 00000100:00100000:1.0:1788684060.839947:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788684060.839953:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:7427:x1875571085679104:12345-0@lo:101: 00010000:00010000:1.0:1788684060.839964:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684060.839977:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abfa2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.839995:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abfa2 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.840004:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abfa2 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.840011:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae1bbf1e, rc 0) 00000100:00100000:1.0:1788684060.840054:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:7427:x1875571085679104:12345-0@lo:101: Request processed in 101us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.840067:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788684060.840677:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056316226 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085678976:12345-0@lo:400: Request processed in 2043us (2832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684060.840687:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684060.840745:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0ac019f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679104:0@lo:101: 00010000:00080000:3.0:1788684060.840751:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000abb1384b x1875571085678976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684060.840763:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abb1384b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085678976:0@lo:400: 00010000:00010000:2.0:1788684060.840763:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.840771:0:7427:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.841359:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c0ac019f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679232:0@lo:256: 00000100:00100000:2.0:1788684060.841709:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.841780:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 000000006133333a going to sleep for 11 seconds 00000100:00100000:1.0:1788684060.841829:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085679232 00000100:00100000:1.0:1788684060.841835:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085679232 00000100:00100000:1.0:1788684060.841911:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788684060.841918:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b8e2e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:7427:x1875571085679232:12345-0@lo:256: 20000000:01000000:1.0:1788684060.841935:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788684060.841952:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788684060.841955:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788684060.842042:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b8e2e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:7427:x1875571085679232:12345-0@lo:256: Request processed in 125us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.842050:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788684060.842118:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0ac019f pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679232:0@lo:256: 10000000:01000000:3.0:1788684060.842717:0:7427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788684060.842735:0:7427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.842745:0:7427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684060.842753:0:7427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677cc6f800 from 1 10000000:01000000:3.0:1788684060.842756:0:7427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788684060.842781:0:7427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.842787:0:7427:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.842795:0:7427:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684060.843445:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a416d17a pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679360:0@lo:101: 00000100:00100000:3.0:1788684060.843496:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788684060.845572:0:6502:0:(import.c:65:import_set_state_nolock()) 00000000e48a47f0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684060.845678:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096798eb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1875571085678848:12345-0@lo:38: Request processed in 7810us (8318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684060.845693:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684060.845749:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684060.845758:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788684060.845766:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788684060.845771:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788684060.845773:0:3622:0:(import.c:65:import_set_state_nolock()) 000000004d8195a6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788684060.845787:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099047ef4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085678848:0@lo:38: 00000100:00100000:0.0:1788684060.845844:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684060.845853:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096f741bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085679488:0@lo:41: 00000100:00100000:0.0:1788684060.845888:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.846080:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad256b9d going to sleep for 11 seconds 00000100:00100000:2.0:1788684060.846306:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085679360 00000100:00100000:2.0:1788684060.846315:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085679360 00000100:00100000:2.0:1788684060.846354:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788684060.846362:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd164dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:7427:x1875571085679360:12345-0@lo:101: 00010000:00010000:2.0:1788684060.846387:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684060.846403:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abfb0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.846426:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abfb0 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.846436:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abfb0 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684060.846454:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085679488 00010000:00010000:2.0:1788684060.846455:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007623f92b, rc 0) 00000100:00100000:1.0:1788684060.846458:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085679488 00000100:00100000:2.0:1788684060.846488:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd164dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7427:x1875571085679360:12345-0@lo:101: Request processed in 127us (2992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.846490:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684060.846494:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788684060.846496:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be8cc02a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1875571085679488:12345-0@lo:41: 00000004:00000024:1.0:1788684060.846517:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788684060.846560:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be8cc02a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1875571085679488:12345-0@lo:41: Request processed in 65us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.846566:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684060.846658:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a416d17a pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679360:0@lo:101: 00010000:00010000:3.0:1788684060.846673:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.846681:0:7427:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684060.846783:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a416d17a pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679616:0@lo:501: 00000100:00100000:3.0:1788684060.846809:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.846836:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad256b9d going to sleep for 11 seconds 00000100:00100000:1.0:1788684060.846885:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085679616 00000100:00100000:1.0:1788684060.846889:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085679616 00000100:00100000:1.0:1788684060.846954:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788684060.846961:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fd319a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7427:x1875571085679616:12345-0@lo:501: 00000100:00100000:2.0:1788684060.847009:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096f741bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085679488:0@lo:41: 00000100:00100000:1.0:1788684060.847047:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fd319a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7427:x1875571085679616:12345-0@lo:501: Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.847054:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684060.847064:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a416d17a pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679616:0@lo:501: 00000100:00100000:2.0:1788684060.847088:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679744:0@lo:503: 00000100:00100000:2.0:1788684060.847125:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.847224:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 000000006133333a going to sleep for 11 seconds 00000100:00100000:0.0:1788684060.847272:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085679744 00000100:00100000:0.0:1788684060.847282:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085679744 00000100:00100000:0.0:1788684060.847312:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684060.847319:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000508d5db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7427:x1875571085679744:12345-0@lo:503: 00000040:00080000:0.0:1788684060.847350:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788684060.847488:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000508d5db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7427:x1875571085679744:12345-0@lo:503: Request processed in 169us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684060.847494:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788684060.847549:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679744:0@lo:503: 00000040:00080000:2.0:1788684060.847900:0:7427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684060.848021:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788684060.848096:0:7427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684060.849169:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788684060.849308:0:7427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788684060.849336:0:7427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788684060.849609:0:7427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.849694:0:7427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684060.849791:0:7427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788684060.849795:0:7427:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d677cc6f800 10000000:01000000:3.0:1788684060.849798:0:7427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d677cc6f800 10000000:01000000:3.0:1788684060.849802:0:7427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788684060.849807:0:7427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d677cc6f800 from 1 10000000:01000000:3.0:1788684060.849810:0:7427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788684060.849855:0:7427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000006b7cf258/0x44bac02bd54abfbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.849863:0:7427:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000006b7cf258/0x44bac02bd54abfbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.849871:0:7427:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000006b7cf258/0x44bac02bd54abfbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684060.849891:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bab16bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679872:0@lo:101: 00000100:00100000:3.0:1788684060.849951:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.850026:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da2e70cf going to sleep for 11 seconds 00000100:00100000:1.0:1788684060.850079:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085679872 00000100:00100000:1.0:1788684060.850092:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085679872 00000100:00100000:1.0:1788684060.850176:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788684060.850184:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49350f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7427:x1875571085679872:12345-0@lo:101: 00010000:00010000:1.0:1788684060.850196:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684060.850217:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5c6dd1e/0x44bac02bd54abfc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abfbe expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.850238:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5c6dd1e/0x44bac02bd54abfc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abfbe expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.850248:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5c6dd1e/0x44bac02bd54abfc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abfbe expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.850255:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5c6dd1e, rc 0) 00000100:00100000:1.0:1788684060.850302:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49350f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085679872:12345-0@lo:101: Request processed in 120us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.850309:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788684060.850631:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bab16bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085679872:0@lo:101: 00010000:00010000:2.0:1788684060.850646:0:7427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000006b7cf258/0x44bac02bd54abfbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.850653:0:7427:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000006b7cf258/0x44bac02bd54abfbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.850733:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680000:0@lo:501: 00000100:00100000:2.0:1788684060.850762:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.851007:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c0eb293 going to sleep for 11 seconds 00000100:00100000:3.0:1788684060.851170:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085680000 00000100:00100000:3.0:1788684060.851175:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085680000 00000100:00100000:3.0:1788684060.851212:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788684060.851220:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ecf5ff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680000:12345-0@lo:501: 00000100:00100000:3.0:1788684060.851326:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ecf5ff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680000:12345-0@lo:501: Request processed in 107us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684060.851333:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684060.851658:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680000:0@lo:501: 00000100:00100000:2.0:1788684060.851692:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680128:0@lo:503: 00000100:00100000:2.0:1788684060.851745:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.851774:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c0eb293 going to sleep for 11 seconds 00000100:00100000:3.0:1788684060.851820:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085680128 00000100:00100000:3.0:1788684060.851825:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085680128 00000100:00100000:3.0:1788684060.851843:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788684060.851848:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026524205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680128:12345-0@lo:503: 00000100:00100000:3.0:1788684060.851927:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026524205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680128:12345-0@lo:503: Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684060.851934:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788684060.851964:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680128:0@lo:503: 00000040:00080000:2.0:1788684060.852196:0:7427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788684060.852270:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680256:0@lo:502: 00000100:00100000:2.0:1788684060.852598:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.852609:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ad382e1 going to sleep for 11 seconds 00000100:00100000:3.0:1788684060.852691:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085680256 00000100:00100000:3.0:1788684060.852695:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085680256 00000100:00100000:3.0:1788684060.852714:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788684060.852727:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c76269c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680256:12345-0@lo:502: 00000100:00100000:3.0:1788684060.852811:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c76269c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680256:12345-0@lo:502: Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684060.852817:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684060.852897:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680256:0@lo:502: 00000040:00080000:2.0:1788684060.853060:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788684060.853085:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788684060.853099:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788684060.853111:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788684060.853124:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788684060.853136:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788684060.853150:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788684060.853179:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788684060.853198:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788684060.853342:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788684060.853360:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788684060.853411:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788684060.853427:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788684060.853529:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788684060.853548:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788684060.853562:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788684060.853590:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788684060.853608:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788684060.853620:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788684060.853635:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788684060.853649:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788684060.853662:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788684060.853677:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788684060.853706:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788684060.853724:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788684060.853738:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788684060.853750:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788684060.853761:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788684060.853789:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680384:0@lo:502: 00000100:00100000:2.0:1788684060.853834:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.853865:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ad382e1 going to sleep for 11 seconds 00000100:00100000:3.0:1788684060.854017:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085680384 00000100:00100000:3.0:1788684060.854023:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085680384 00000100:00100000:3.0:1788684060.854050:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788684060.854056:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cf77efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680384:12345-0@lo:502: 00000100:00100000:3.0:1788684060.854149:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cf77efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680384:12345-0@lo:502: Request processed in 93us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684060.854157:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788684060.855255:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1b5dcbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680384:0@lo:502: 00000040:00080000:2.0:1788684060.855331:0:7427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788684060.855342:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788684060.856054:0:7445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788684060.856080:0:7445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000ab4af914) 00000020:00000080:2.0:1788684060.856106:0:7445:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788684060.856182:0:7445:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003d509353 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788684060.856187:0:7445:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003d509353 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788684060.856189:0:7445:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003d509353 3 00010000:00080000:2.0:1788684060.856231:0:7445:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f3aa425e@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684060.859774:0:7445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788684060.860040:0:7445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788684060.860114:0:7445:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788684060.860126:0:7445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x44bac02bd54abfd3 00000100:00080000:3.0:1788684060.860137:0:7445:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684060.860143:0:7445:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000f3aa425e using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684060.860182:0:7445:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000343a8e47 x1875571085680512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684060.860223:0:7445:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788684060.860698:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000343a8e47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085680512:0@lo:38: 00000100:00100000:2.0:1788684060.860771:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.860827:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085680512 00000100:00100000:2.0:1788684060.860834:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085680512 00000100:00100000:2.0:1788684060.860863:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684060.860869:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b5dcbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085680512:12345-0@lo:38: 00010000:00080000:2.0:1788684060.860893:0:6497:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 141 last 0 00000020:00000080:2.0:1788684060.860922:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x44bac02bd54abfda 00000004:00100000:2.0:1788684060.860935:0:6497:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788684060.860962:0:6497:0:(import.c:65:import_set_state_nolock()) 00000000df587c14 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684060.861008:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b5dcbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875571085680512:12345-0@lo:38: Request processed in 138us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684060.861016:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788684060.861051:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000343a8e47 x1875571085680512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684060.861061:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684060.861069:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788684060.861085:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788684060.861089:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788684060.861091:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000f3aa425e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788684060.861097:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000343a8e47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085680512:0@lo:38: 00000040:00080000:3.0:1788684060.861789:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788684060.861856:0:7427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788684060.861878:0:7427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788684060.861898:0:7427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000006b7cf258/0x44bac02bd54abfbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684060.861908:0:7427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000006b7cf258/0x44bac02bd54abfbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788684060.861960:0:7427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788684060.861962:0:7427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788684060.861964:0:7427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684060.861965:0:7427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684060.861966:0:7427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684060.861967:0:7427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684060.861968:0:7427:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684060.861970:0:7427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684060.861971:0:7427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684060.861972:0:7427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684060.861974:0:7427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684060.861977:0:7427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788684060.861979:0:7427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684060.861981:0:7427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788684060.861982:0:7427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684060.861983:0:7427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684060.861984:0:7427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684060.861985:0:7427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684060.861985:0:7427:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684060.861986:0:7427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684060.861988:0:7427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684060.861989:0:7427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684060.861989:0:7427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684060.862009:0:7427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788684060.862021:0:7427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1620c17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680640:0@lo:253: 00000100:00100000:3.0:1788684060.862070:0:7427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.862106:0:7427:0:(client.c:2716:ptlrpc_set_wait()) set 00000000520ac7cb going to sleep for 11 seconds 00000100:00100000:3.0:1788684060.862128:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085680640 00000100:00100000:3.0:1788684060.862133:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085680640 00000100:00100000:3.0:1788684060.862168:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788684060.862175:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aedb1378 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680640:12345-0@lo:253: 20000000:01000000:3.0:1788684060.862217:0:6490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788684060.862232:0:6490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:2.0:1788684060.862776:0:7446:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:0.0:1788684060.867638:0:6476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788684060.869096:0:6490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788684060.869120:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788684060.869359:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788684060.869406:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788684060.869427:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.869446:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abefa expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.869452:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abfa2 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.869459:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.869496:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abfa2 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.869508:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abfa2 expref: 15 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.869520:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024347d53 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085680768:0@lo:104: 00000100:00100000:2.0:1788684060.869593:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684060.869640:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abefa expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.869661:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abefa expref: 15 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.869670:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a5b6288 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085680896:0@lo:104: 00000100:00100000:2.0:1788684060.869694:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.869718:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089f22ce5 going to sleep for 11 seconds 00000100:00100000:0.0:1788684060.869767:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085680768 00000100:00100000:0.0:1788684060.869782:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085680768 00000100:00100000:0.0:1788684060.869840:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085680896 00000100:00100000:0.0:1788684060.869940:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085680896 00000100:00100000:0.0:1788684060.869969:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684060.869979:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072c0df79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6513:x1875571085680768:12345-0@lo:104: 00010000:00010000:0.0:1788684060.870000:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684060.870095:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684060.870102:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072c0df79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6513:x1875571085680768:12345-0@lo:104: Request processed in 125us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684060.870110:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684060.870133:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788684060.870141:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023405f5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6513:x1875571085680896:12345-0@lo:104: 00010000:00010000:0.0:1788684060.870148:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684060.870181:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788684060.870186:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023405f5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6513:x1875571085680896:12345-0@lo:104: Request processed in 47us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684060.870203:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788684060.871440:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684060.871450:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.871461:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d9b6e7f already unused, calling callback (0000000028cfecd8) 10000000:00010000:1.0:1788684060.871465:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.871474:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684060.871494:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684060.871499:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684060.871549:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.871557:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684060.871588:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.871596:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abfa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abfa9 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.871610:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684060.871612:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.871618:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000315caaa2 already unused, calling callback (0000000028cfecd8) 10000000:00010000:1.0:1788684060.871625:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684060.871625:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aedb1378 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:7427:x1875571085680640:12345-0@lo:253: Request processed in 9443us (9548us total) trans 0 rc 0/0 00010000:00010000:1.0:1788684060.871652:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684060.871653:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 10000000:00010000:1.0:1788684060.871666:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684060.871672:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684060.871696:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.871702:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684060.871721:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.871727:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 00000000315caaa2/0x44bac02bd54abefa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abf01 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.871742:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684060.871743:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684060.871745:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684060.871753:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684060.871765:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684060.871781:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3b4f4aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085681024:0@lo:103: 00000100:00100000:1.0:1788684060.871835:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684060.871889:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684060.871897:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007ca3a99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085681152:0@lo:103: 00000100:00100000:1.0:1788684060.871923:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684060.871950:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085681024 00000100:00100000:1.0:1788684060.871957:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085681024 00010000:00010000:1.0:1788684060.871980:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abfa2 expref: 15 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684060.872004:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085681152 00000100:00100000:1.0:1788684060.872007:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085681152 00010000:00010000:1.0:1788684060.872016:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abefa expref: 16 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684060.872027:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788684060.872042:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000522e28aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:3623:x1875571085681024:12345-0@lo:103: 00010000:00010000:1.0:1788684060.872055:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684060.872060:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abfa2 expref: 16 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.872069:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abfa2 expref: 16 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.872085:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684060.872117:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000522e28aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:3623:x1875571085681024:12345-0@lo:103: Request processed in 76us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.872124:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788684060.872140:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788684060.872145:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d71142fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3626:x1875571085681152:12345-0@lo:103: 00010000:00010000:1.0:1788684060.872153:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684060.872156:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abefa expref: 15 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.872164:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abefa expref: 15 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.872174:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.872181:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788684060.872195:0:6484:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002789353s 00010000:00010000:1.0:1788684060.872198:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.872444:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ae1bbf1e/0x44bac02bd54abfa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abfa2 expref: 15 pid: 6490 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.872461:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024347d53 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085680768:0@lo:104: 00010000:00010000:2.0:1788684060.872472:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000014833d4e/0x44bac02bd54abf01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abefa expref: 14 pid: 6489 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684060.872480:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a5b6288 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085680896:0@lo:104: 00010000:00010000:2.0:1788684060.872502:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.872510:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684060.872516:0:6513:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684060.873355:0:7427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1620c17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7427:1875571085680640:0@lo:253: 10000000:01000000:3.0:1788684060.873568:0:7427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788684060.873571:0:7427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684060.873583:0:7427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788684060.873584:0:7427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684060.873585:0:7427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684060.873586:0:7427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684060.873587:0:7427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684060.873589:0:7427:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684060.873590:0:7427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684060.873591:0:7427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684060.873593:0:7427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684060.873594:0:7427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788684060.873606:0:7427:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788684060.876603:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.876611:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.876617:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.876623:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d872597 already unused, calling callback (0000000048a072f0) 00010000:00010000:1.0:1788684060.876627:0:6484:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.876636:0:6484:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.876648:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.876656:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000d872597/0x44bac02bd54abfe1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684060.876679:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684060.876762:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d71142fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:3626:x1875571085681152:12345-0@lo:103: Request processed in 4615us (4837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684060.876772:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788684060.876855:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3b4f4aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085681024:0@lo:103: 00000100:00100000:0.0:1788684060.876968:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007ca3a99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085681152:0@lo:103: 00080000:10000000:3.0:1788684060.882857:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788684060.883011:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788684060.883172:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788684060.883588:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788684060.883759:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788684060.883895:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788684060.886692:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788684060.886956:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788684060.887145:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788684060.887669:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788684060.887881:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788684060.888062:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788684060.890637:0:7427:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788684060.890929:0:7451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788684060.890978:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1620c17 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7451:1875571085681280:0@lo:700: 00000100:00100000:3.0:1788684060.891047:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.891132:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e42ee7af going to sleep for 11 seconds 00000040:01000000:1.0:1788684060.891177:0:7427:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:1.0:1788684060.891828:0:7427:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788684060.891945:0:7427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788684060.892688:0:7427:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788684060.892698:0:7427:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788684060.892846:0:7427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788684060.893657:0:7450:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788684060.893663:0:7450:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788684060.894685:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007515765d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085681408:0@lo:1000: 00000100:00100000:0.0:1788684060.894756:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684060.894815:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012d872a4 going to sleep for 11 seconds 00000100:00100000:3.0:1788684060.894889:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085681408 00000100:00100000:3.0:1788684060.894901:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085681408 00000100:00100000:3.0:1788684060.894953:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684060.894961:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000500b9120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085681408:12345-0@lo:1000: 00000100:00100000:3.0:1788684060.895040:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000500b9120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085681408:12345-0@lo:1000: Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684060.895047:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684060.895089:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007515765d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085681408:0@lo:1000: 00000040:01000000:3.0:1788684060.895119:0:7452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788684060.895144:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085681536:0@lo:700: 00000100:00100000:3.0:1788684060.895170:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.895195:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085681536 00000100:00100000:3.0:1788684060.895198:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085681536 00000100:00100000:3.0:1788684060.895300:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684060.895306:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003624279a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085681536:12345-0@lo:700: 00000100:00100000:3.0:1788684060.895342:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003624279a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085681536:12345-0@lo:700: Request processed in 37us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684060.895348:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684060.895394:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094299ace going to sleep for 11 seconds 00000100:00100000:3.0:1788684060.895407:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085681536:0@lo:700: 00000100:00100000:3.0:1788684060.895864:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7452:1875571085681664:0@lo:900: 00000100:00100000:3.0:1788684060.895896:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.895927:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085681664 00000100:00100000:3.0:1788684060.895931:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085681664 00000100:00100000:3.0:1788684060.895956:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684060.895963:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059351008 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7452:x1875571085681664:12345-0@lo:900: 00000100:00100000:3.0:1788684060.895997:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059351008 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7452:x1875571085681664:12345-0@lo:900: Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684060.896010:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684060.896031:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094299ace going to sleep for 11 seconds 00010000:00080000:3.0:1788684060.896046:0:7452:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000030f91542 x1875571085681664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788684076 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684060.896056:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7452:1875571085681664:0@lo:900: 00000100:00100000:3.0:1788684060.896131:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085681792:0@lo:1000: 00000100:00100000:3.0:1788684060.896166:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.896186:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085681792 00000100:00100000:3.0:1788684060.896190:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085681792 00000100:00100000:0.0:1788684060.896584:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684060.896597:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b3d21fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085681792:12345-0@lo:1000: 00000100:00100000:0.0:1788684060.896655:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b3d21fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085681792:12345-0@lo:1000: Request processed in 63us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684060.896662:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1788684060.896961:0:7427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788684060.897313:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbf066b0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684060.897332:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085681792:0@lo:1000: 00000004:00080000:3.0:1788684060.897610:0:7452:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000094299ace with version 0 00000020:00100000:3.0:1788684060.897629:0:7452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788684060.897635:0:7452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000030f91542 x1875571085682048/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684060.897649:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085682048:0@lo:1000: 00000100:00100000:3.0:1788684060.897684:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684060.897707:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dcc2bcf going to sleep for 11 seconds 00000100:00100000:0.0:1788684060.897861:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085682048 00000100:00100000:0.0:1788684060.897867:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085682048 00000100:00100000:0.0:1788684060.897909:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684060.897916:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e7b42a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085682048:12345-0@lo:1000: 00000100:00100000:3.0:1788684060.898291:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085681280 00000100:00100000:3.0:1788684060.898296:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085681280 00000100:00100000:3.0:1788684060.898329:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684060.898334:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057c7a2e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7451:x1875571085681280:12345-0@lo:700: 00000040:00080000:1.0:1788684060.899111:0:7427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788684060.899170:0:7427:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788684060.899724:0:7427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788684060.899954:0:7427:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788684060.901316:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788684060.906820:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788684060.906997:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788684060.907164:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788684060.907602:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788684060.907808:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788684060.907956:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788684060.908100:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000001:00080000:1.0:1788684060.908649:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:0.0:1788684060.908800:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788684060.908952:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788684060.909097:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788684060.909254:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788684060.909702:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788684060.909845:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788684060.909983:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788684060.910112:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788684060.910839:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788684060.910964:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788684060.911076:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788684060.911670:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788684060.911799:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788684060.911907:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788684060.912021:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788684060.912344:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788684060.912661:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788684060.912780:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788684060.912894:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788684060.913013:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788684060.913122:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788684060.913653:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788684060.913779:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788684060.913956:0:7427:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788684060.914127:0:7427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 40000000:02000000:3.0:1788684060.914681:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1788684060.920553:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e7b42a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085682048:12345-0@lo:1000: Request processed in 22629us (22860us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788684060.920583:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788684060.920647:0:7452:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788684060.920652:0:7452:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788684060.920679:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085682048:0@lo:1000: 00000100:00100000:2.0:1788684060.920764:0:7452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a5b6288 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085682176:0@lo:1000: 00000100:00100000:2.0:1788684060.920803:0:7452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.920834:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085682176 00000100:00100000:2.0:1788684060.920840:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085682176 00000100:00100000:2.0:1788684060.920877:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684060.920884:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024347d53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085682176:12345-0@lo:1000: 00000100:00100000:2.0:1788684060.920944:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024347d53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875571085682176:12345-0@lo:1000: Request processed in 60us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684060.920950:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684060.920984:0:7452:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d7ac80d going to sleep for 11 seconds 00000100:00100000:2.0:1788684060.920997:0:7452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a5b6288 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7452:1875571085682176:0@lo:1000: 00000040:00080000:2.0:1788684060.921013:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788684060.921039:0:7452:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001d6e5fdb with version 1 00000004:00080000:2.0:1788684060.921055:0:7442:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000006e2abe60 version 1 rpc_version 1 00000020:00100000:2.0:1788684060.921067:0:7442:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788684060.921072:0:7442:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002a5b6288 x1875571085682432/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684060.921084:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a5b6288 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7442:1875571085682432:0@lo:1000: 00000100:00100000:2.0:1788684060.921107:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684060.921122:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb912af7 going to sleep for 11 seconds 00000100:00100000:2.0:1788684060.921133:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085682432 00000100:00100000:2.0:1788684060.921151:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085682432 00000100:00100000:2.0:1788684060.921174:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684060.921178:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba553b7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7442:x1875571085682432:12345-0@lo:1000: 00000001:00080000:0.0:1788684060.925324:0:7427:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788684060.927258:0:7427:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb81ec1cbf988 00100000:10000000:0.0:1788684060.927272:0:7427:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788684060.928009:0:7427:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788684060.928043:0:7427:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788684060.928076:0:7427:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788684060.928096:0:7427:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788684060.929189:0:7427:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:3.0:1788684060.929672:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057c7a2e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7451:x1875571085681280:12345-0@lo:700: Request processed in 31335us (38622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684060.929693:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788684060.929739:0:7451:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c1620c17 x1875571085681280/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788684076 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684060.929751:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1620c17 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7451:1875571085681280:0@lo:700: 40000000:02000000:3.0:1788684060.929763:0:7451:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000020:00000004:1.0:1788684060.932002:0:7427:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1788684060.935638:0:7452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788684060.935726:0:7452:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1788684060.942625:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788684060.942762:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba553b7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7442:x1875571085682432:12345-0@lo:1000: Request processed in 21580us (21650us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788684060.942774:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788684060.943325:0:7442:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788684060.943332:0:7442:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788684060.943348:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a5b6288 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7442:1875571085682432:0@lo:1000: 00000040:00080000:3.0:1788684060.982980:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684060.998106:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788684060.998182:0:7451:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788684060.998186:0:7451:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788684061.313497:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684062.334032:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684063.361075:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684064.381639:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788684064.776138:0:7696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788684065.416062:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788684065.626729:0:7749:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684065.626953:0:7749:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788684065.918642:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3b4f4aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085682560:0@lo:400: 00000100:00100000:1.0:1788684065.918706:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684065.918751:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684065.918757:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdf387d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085682944:0@lo:400: 00000100:00100000:1.0:1788684065.918826:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684065.918859:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005aaf4c92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085682688:0@lo:400: 00000100:00100000:1.0:1788684065.918882:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684065.918900:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684065.918905:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053d29ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085682816:0@lo:400: 00000100:00100000:1.0:1788684065.918945:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684065.918988:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085682560 00000100:00100000:1.0:1788684065.918995:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085682560 00000100:00100000:1.0:1788684065.919036:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788684065.919043:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000876fc4f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:3626:x1875571085682560:12345-0@lo:400: 00000100:00100000:1.0:1788684065.919087:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000876fc4f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:3626:x1875571085682560:12345-0@lo:400: Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684065.919094:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788684065.919123:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085682944 00000100:00100000:1.0:1788684065.919126:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085682944 00000100:00100000:1.0:1788684065.919145:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085682688 00000100:00100000:1.0:1788684065.919147:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085682688 00000100:00100000:1.0:1788684065.919159:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788684065.919164:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039379c97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085682944:12345-0@lo:400: 00000100:00100000:1.0:1788684065.919193:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039379c97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085682944:12345-0@lo:400: Request processed in 29us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684065.919199:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788684065.919209:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788684065.919214:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d5f837 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085682688:12345-0@lo:400: 00000100:00100000:1.0:1788684065.919247:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d5f837 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085682688:12345-0@lo:400: Request processed in 33us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684065.919253:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788684065.919287:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005aaf4c92 x1875571085682688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684065.919302:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005aaf4c92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085682688:0@lo:400: 00010000:00080000:1.0:1788684065.919325:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cdf387d1 x1875571085682944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684065.919345:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdf387d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085682944:0@lo:400: 00000100:00100000:1.0:1788684065.919356:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3b4f4aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085682560:0@lo:400: 00000100:00100000:2.0:1788684065.919595:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085682816 00000100:00100000:2.0:1788684065.919599:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085682816 00000100:00100000:2.0:1788684065.919634:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684065.919641:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000522e28aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085682816:12345-0@lo:400: 00000100:00100000:2.0:1788684065.919686:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000522e28aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085682816:12345-0@lo:400: Request processed in 46us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684065.919693:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684065.919721:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053d29ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085682816:0@lo:400: 00000100:00100000:2.0:1788684065.919857:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000261ea6c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085683072:0@lo:41: 00000100:00100000:2.0:1788684065.919884:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684065.919943:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085683072 00000100:00100000:0.0:1788684065.919956:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085683072 00000100:00100000:0.0:1788684065.919975:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684065.919980:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a5b6288 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085683072:12345-0@lo:41: 00000004:00000024:0.0:1788684065.920002:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788684065.920045:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a5b6288 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085683072:12345-0@lo:41: Request processed in 65us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684065.920051:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788684065.920147:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000261ea6c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085683072:0@lo:41: 00010000:00010000:1.0:1788684066.429647:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684067.456314:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788684068.270839:0:7850:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684068.271032:0:7850:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684068.477812:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788684069.180702:0:7898:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5a97ccc0 20000000:00000080:3.0:1788684069.180719:0:7898:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d677e2cc000 uarg=0000000000000000 20000000:01000000:3.0:1788684069.180761:0:7898:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788684069.180767:0:7898:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788684069.180771:0:7898:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788684069.180837:0:7898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788684069.180847:0:7898:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788684069.188019:0:7898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684069.188244:0:7898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788684069.188274:0:7898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788684069.188290:0:7898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788684069.188305:0:7898:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788684069.188321:0:7898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684069.188338:0:7898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abec2 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684069.188344:0:7898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abfb0 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684069.188357:0:7898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684069.188482:0:7898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abfb0 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684069.188495:0:7898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abfb0 expref: 12 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684069.188509:0:7898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1620c17 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7898:1875571085683200:0@lo:104: 00000100:00100000:3.0:1788684069.188578:0:7898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684069.188645:0:7898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abec2 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684069.188653:0:7898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abec2 expref: 12 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684069.188661:0:7898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7898:1875571085683328:0@lo:104: 00000100:00100000:3.0:1788684069.188690:0:7898:0:(client.c:2716:ptlrpc_set_wait()) set 00000000258971bf going to sleep for 11 seconds 00000100:00100000:2.0:1788684069.189182:0:6481:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788684069.189203:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684069.189231:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085683200 00000100:00100000:2.0:1788684069.189237:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085683200 00000100:00100000:2.0:1788684069.189266:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085683328 00000100:00100000:2.0:1788684069.189269:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085683328 00000100:00100000:2.0:1788684069.189280:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684069.189285:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000313cf81c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:7898:x1875571085683200:12345-0@lo:104: 00010000:00010000:2.0:1788684069.189304:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189383:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788684069.189389:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000313cf81c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:7898:x1875571085683200:12345-0@lo:104: Request processed in 104us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684069.189396:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684069.189432:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684069.189438:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ee35609 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:7898:x1875571085683328:12345-0@lo:104: 00010000:00010000:2.0:1788684069.189444:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189478:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788684069.189482:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ee35609 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:7898:x1875571085683328:12345-0@lo:104: Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684069.189487:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788684069.189500:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684069.189504:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189511:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000023e81184 already unused, calling callback (0000000028cfecd8) 10000000:00010000:2.0:1788684069.189513:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189520:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684069.189526:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684069.189551:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684069.189576:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189582:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684069.189598:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189604:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 0000000023e81184/0x44bac02bd54abfb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abfb7 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189616:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684069.189618:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189623:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea6dd17d already unused, calling callback (0000000028cfecd8) 10000000:00010000:2.0:1788684069.189625:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189631:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684069.189635:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684069.189640:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684069.189650:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189655:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684069.189667:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189672:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 00000000ea6dd17d/0x44bac02bd54abec2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abec9 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189684:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684069.189686:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684069.189687:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684069.189693:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684069.189703:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085683456:0@lo:103: 00000100:00100000:2.0:1788684069.189731:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684069.189751:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788684069.189757:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023405f5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085683584:0@lo:103: 00000100:00100000:2.0:1788684069.189781:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684069.189801:0:7898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1620c17 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7898:1875571085683200:0@lo:104: 00000100:00100000:3.0:1788684069.189815:0:7898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030f91542 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7898:1875571085683328:0@lo:104: 00000100:00100000:2.0:1788684069.189825:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085683456 00000100:00100000:2.0:1788684069.189831:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085683456 00010000:00010000:3.0:1788684069.189837:0:7898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189849:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abfb0 expref: 13 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684069.189887:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085683584 00000100:00100000:2.0:1788684069.189890:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085683584 00010000:00010000:2.0:1788684069.189901:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abec2 expref: 14 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684069.189913:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684069.189919:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000066effd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:3623:x1875571085683456:12345-0@lo:103: 00010000:00010000:2.0:1788684069.189927:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684069.189931:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abfb0 expref: 14 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189950:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abfb0 expref: 14 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189962:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007623f92b/0x44bac02bd54abfb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abfb0 expref: 14 pid: 6490 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.189975:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684069.190003:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000066effd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:3623:x1875571085683456:12345-0@lo:103: Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684069.190009:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684069.190022:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684069.190028:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015940cb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:3623:x1875571085683584:12345-0@lo:103: 00010000:00010000:2.0:1788684069.190035:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684069.190038:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abec2 expref: 12 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190046:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abec2 expref: 12 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190054:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000363411d9/0x44bac02bd54abec9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abec2 expref: 12 pid: 6489 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190064:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190071:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190083:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190095:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190101:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190105:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190110:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000515547b0 already unused, calling callback (0000000048a072f0) 00010000:00010000:2.0:1788684069.190113:0:6484:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190120:0:6484:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190131:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.190140:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684069.190163:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015940cb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:3623:x1875571085683584:12345-0@lo:103: Request processed in 136us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684069.190169:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684069.190193:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023405f5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085683584:0@lo:103: 00000100:00100000:2.0:1788684069.190200:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085683456:0@lo:103: 00010000:00010000:3.0:1788684069.191966:0:7898:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684069.191983:0:7898:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684069.192002:0:7898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000515547b0/0x44bac02bd54abfe8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684069.502178:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788684070.275661:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788684070.275669:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d677cc6f800 from 4 10000000:01000000:2.0:1788684070.275674:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788684070.275863:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000363411d9/0x44bac02bd54abfef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.275875:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000363411d9/0x44bac02bd54abfef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.275885:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000363411d9/0x44bac02bd54abfef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684070.275907:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085683712:0@lo:101: 00000100:00100000:2.0:1788684070.275968:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.276011:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000006133333a going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.276058:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085683712 00000100:00100000:0.0:1788684070.276065:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085683712 00000100:00100000:0.0:1788684070.276113:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788684070.276121:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000413f0fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+11:6495:x1875571085683712:12345-0@lo:101: 00010000:00010000:0.0:1788684070.276132:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684070.276144:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000315caaa2/0x44bac02bd54abff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abfef expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.276163:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000315caaa2/0x44bac02bd54abff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abfef expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.276173:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000315caaa2/0x44bac02bd54abff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abfef expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.276187:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000315caaa2, rc 0) 00000100:00100000:0.0:1788684070.276233:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000413f0fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6495:x1875571085683712:12345-0@lo:101: Request processed in 112us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.276239:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788684070.276345:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085683712:0@lo:101: 00010000:00010000:2.0:1788684070.276360:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000363411d9/0x44bac02bd54abfef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.276402:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000363411d9/0x44bac02bd54abfef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684070.276446:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085683840:0@lo:256: 00000100:00100000:2.0:1788684070.276477:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.276495:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000006133333a going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.276683:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085683840 00000100:00100000:0.0:1788684070.276688:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085683840 00000100:00100000:0.0:1788684070.276900:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684070.276908:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086944a96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6495:x1875571085683840:12345-0@lo:256: 20000000:01000000:0.0:1788684070.276921:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788684070.276935:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788684070.276938:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788684070.277028:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086944a96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6495:x1875571085683840:12345-0@lo:256: Request processed in 121us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.277035:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788684070.277135:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085683840:0@lo:256: 10000000:01000000:2.0:1788684070.277176:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788684070.277181:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000363411d9/0x44bac02bd54abfef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.277189:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000363411d9/0x44bac02bd54abfef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684070.277203:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684070.277205:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677cc6f800 from 1 10000000:01000000:2.0:1788684070.277207:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684070.277224:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abffd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.277230:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abffd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.277237:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abffd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684070.277248:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085683968:0@lo:101: 00000100:00100000:2.0:1788684070.277273:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.277302:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000006133333a going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.277352:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085683968 00000100:00100000:1.0:1788684070.277356:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085683968 00000100:00100000:1.0:1788684070.277412:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788684070.277418:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c177f3aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+12:6495:x1875571085683968:12345-0@lo:101: 00010000:00010000:1.0:1788684070.277425:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684070.277434:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000870ab135/0x44bac02bd54ac004 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54abffd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.277448:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000870ab135/0x44bac02bd54ac004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54abffd expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.277456:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000870ab135/0x44bac02bd54ac004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abffd expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.277462:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000870ab135, rc 0) 00000100:00100000:1.0:1788684070.277492:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c177f3aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:6495:x1875571085683968:12345-0@lo:101: Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.277497:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788684070.277671:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085683968:0@lo:101: 00010000:00010000:2.0:1788684070.277682:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abffd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.277688:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000005d9b6e7f/0x44bac02bd54abffd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684070.277808:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684096:0@lo:501: 00000100:00100000:2.0:1788684070.277834:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.277849:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000006133333a going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.277895:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085684096 00000100:00100000:1.0:1788684070.277899:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085684096 00000100:00100000:1.0:1788684070.277932:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788684070.277938:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab5fc1cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:6495:x1875571085684096:12345-0@lo:501: 00000100:00100000:1.0:1788684070.278033:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab5fc1cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:6495:x1875571085684096:12345-0@lo:501: Request processed in 95us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.278046:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788684070.278142:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684096:0@lo:501: 00000100:00100000:2.0:1788684070.278168:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684224:0@lo:503: 00000100:00100000:2.0:1788684070.278209:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.278229:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set 000000006133333a going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.278272:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085684224 00000100:00100000:1.0:1788684070.278276:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085684224 00000100:00100000:1.0:1788684070.278303:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788684070.278308:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000783dfd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:6495:x1875571085684224:12345-0@lo:503: 00000100:00100000:1.0:1788684070.278407:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000783dfd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:6495:x1875571085684224:12345-0@lo:503: Request processed in 99us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.278413:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788684070.278493:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072c0df79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684224:0@lo:503: 00000100:00100000:0.0:1788684070.278971:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af6f3e91 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7954:1875571085684352:0@lo:502: 00000100:00100000:0.0:1788684070.279008:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684070.279070:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f3750ad going to sleep for 11 seconds 00000100:00100000:2.0:1788684070.282678:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085684352 00000100:00100000:2.0:1788684070.282693:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085684352 00000100:00100000:2.0:1788684070.282856:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788684070.282866:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fad8e5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:7954:x1875571085684352:12345-0@lo:502: 00000100:00100000:2.0:1788684070.283022:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fad8e5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:7954:x1875571085684352:12345-0@lo:502: Request processed in 157us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684070.283030:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788684070.283416:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af6f3e91 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7954:1875571085684352:0@lo:502: 00000020:01000000:0.0:1788684070.283449:0:7954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684070.283467:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684070.283470:0:7954:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788684070.283477:0:7954:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d677cc6f800 00000020:00000080:0.0:1788684070.283480:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788684070.283538:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7954:1875571085684480:0@lo:502: 00000100:00100000:0.0:1788684070.283595:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684070.284128:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238900 going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.284192:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085684480 00000100:00100000:1.0:1788684070.284197:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085684480 00000100:00100000:1.0:1788684070.284228:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788684070.284235:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:7954:x1875571085684480:12345-0@lo:502: 00000100:00100000:1.0:1788684070.284333:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:7954:x1875571085684480:12345-0@lo:502: Request processed in 96us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.284340:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788684070.284478:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7954:1875571085684480:0@lo:502: 00000020:01000000:0.0:1788684070.284501:0:7954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684070.284507:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684070.284509:0:7954:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788684070.284513:0:7954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788684070.284719:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788684070.284738:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788684070.284747:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.284759:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684070.284768:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788684070.284771:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67466b4800 from 21 10000000:01000000:1.0:1788684070.284773:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788684070.284799:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.284818:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.284828:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684070.284842:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684608:0@lo:101: 00000100:00100000:1.0:1788684070.284873:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.284899:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.284999:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085684608 00000100:00100000:0.0:1788684070.285003:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085684608 00000100:00100000:0.0:1788684070.285024:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788684070.285031:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:6495:x1875571085684608:12345-0@lo:101: 00010000:00010000:0.0:1788684070.285039:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684070.285050:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac00b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.285069:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac00b expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.285079:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac00b expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.285088:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740030600, rc 0) 00000100:00100000:0.0:1788684070.285126:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:6495:x1875571085684608:12345-0@lo:101: Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.285132:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788684070.285233:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684608:0@lo:101: 00010000:00010000:1.0:1788684070.285246:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.285253:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684070.285298:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684736:0@lo:501: 00000100:00100000:1.0:1788684070.285321:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.285342:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.285405:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085684736 00000100:00100000:0.0:1788684070.285409:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085684736 00000100:00100000:0.0:1788684070.285432:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788684070.285438:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:6495:x1875571085684736:12345-0@lo:501: 00000100:00100000:0.0:1788684070.285540:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:6495:x1875571085684736:12345-0@lo:501: Request processed in 101us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.285556:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684070.285845:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684736:0@lo:501: 00000100:00100000:1.0:1788684070.285870:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684864:0@lo:503: 00000100:00100000:1.0:1788684070.285904:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.285932:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.285972:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085684864 00000100:00100000:0.0:1788684070.285975:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085684864 00000100:00100000:0.0:1788684070.286001:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788684070.286007:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:6495:x1875571085684864:12345-0@lo:503: 00000100:00100000:0.0:1788684070.286087:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:6495:x1875571085684864:12345-0@lo:503: Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.286094:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788684070.286166:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085684864:0@lo:503: 00000100:00100000:1.0:1788684070.286519:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7955:1875571085684992:0@lo:502: 00000100:00100000:1.0:1788684070.286631:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.286657:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.286700:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085684992 00000100:00100000:0.0:1788684070.286765:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085684992 00000100:00100000:0.0:1788684070.286786:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788684070.286792:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7955:x1875571085684992:12345-0@lo:502: 00000100:00100000:0.0:1788684070.286872:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7955:x1875571085684992:12345-0@lo:502: Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.286879:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788684070.286997:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7955:1875571085684992:0@lo:502: 00000100:00100000:1.0:1788684070.287034:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7955:1875571085685120:0@lo:502: 00000100:00100000:1.0:1788684070.287065:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.287085:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.287126:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085685120 00000100:00100000:0.0:1788684070.287130:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085685120 00000100:00100000:0.0:1788684070.287158:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684070.287165:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7955:x1875571085685120:12345-0@lo:502: 00000100:00100000:0.0:1788684070.287231:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:7955:x1875571085685120:12345-0@lo:502: Request processed in 66us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.287238:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788684070.287330:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7955:1875571085685120:0@lo:502: 00000040:00080000:1.0:1788684070.287347:0:7955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788684070.287793:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788684070.287812:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788684070.287820:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.287840:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684070.287849:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684070.287851:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d67466b4800 from 4 10000000:01000000:0.0:1788684070.287854:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684070.287875:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.287882:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.287890:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684070.287903:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685248:0@lo:101: 00000100:00100000:0.0:1788684070.287932:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684070.288667:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684070.290658:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085685248 00000100:00100000:3.0:1788684070.290668:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085685248 00000100:00100000:2.0:1788684070.291474:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788684070.291486:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:6495:x1875571085685248:12345-0@lo:101: 00010000:00010000:2.0:1788684070.291500:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684070.291516:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac019 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.291551:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac019 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.291561:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac019 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.291633:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67560a6e00, rc 0) 00000100:00100000:2.0:1788684070.291809:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085685248:12345-0@lo:101: Request processed in 325us (3874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684070.291816:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788684070.293649:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685248:0@lo:101: 00010000:00010000:0.0:1788684070.293674:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.293684:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684070.293834:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685376:0@lo:256: 00000100:00100000:0.0:1788684070.293885:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684070.293963:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684070.298321:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085685376 00000100:00100000:2.0:1788684070.298341:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085685376 00000100:00100000:2.0:1788684070.298460:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788684070.298469:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085685376:12345-0@lo:256: 20000000:01000000:2.0:1788684070.298492:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788684070.298506:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788684070.298510:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788684070.299676:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085685376:12345-0@lo:256: Request processed in 1203us (5785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684070.299686:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788684070.302549:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685376:0@lo:256: 10000000:01000000:2.0:1788684070.302811:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788684070.302822:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.302832:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684070.302841:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788684070.302843:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788684070.302846:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788684070.302878:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.302886:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.302895:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684070.302912:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685504:0@lo:101: 00000100:00100000:2.0:1788684070.302965:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.303051:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788684070.307548:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085685504 00000100:00100000:3.0:1788684070.307562:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085685504 00000100:00100000:3.0:1788684070.307694:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788684070.307819:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085685504:12345-0@lo:101: 00010000:00010000:3.0:1788684070.307838:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684070.307857:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac027 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684070.307882:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac027 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684070.307893:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac027 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684070.307902:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67820efa00, rc 0) 00000100:00100000:3.0:1788684070.308017:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085685504:12345-0@lo:101: Request processed in 314us (5051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684070.308024:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788684070.313075:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685504:0@lo:101: 00010000:00010000:1.0:1788684070.313107:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.313121:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684070.313203:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685632:0@lo:501: 00000100:00100000:1.0:1788684070.313260:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.313303:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684070.316619:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085685632 00000100:00100000:2.0:1788684070.316634:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085685632 00000100:00100000:2.0:1788684070.316687:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788684070.316697:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085685632:12345-0@lo:501: 00000100:00100000:2.0:1788684070.316872:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085685632:12345-0@lo:501: Request processed in 176us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684070.316881:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788684070.318044:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685632:0@lo:501: 00000100:00100000:1.0:1788684070.318107:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685760:0@lo:503: 00000100:00100000:1.0:1788684070.318181:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.318226:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1788684070.322532:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085685760 00000100:00100000:3.0:1788684070.322548:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085685760 00000100:00100000:3.0:1788684070.322614:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788684070.322624:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085685760:12345-0@lo:503: 00000100:00100000:3.0:1788684070.322781:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085685760:12345-0@lo:503: Request processed in 158us (4599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684070.322795:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788684070.324550:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085685760:0@lo:503: 00000100:00100000:2.0:1788684070.336075:0:7960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7960:1875571085685888:0@lo:502: 00000100:00100000:2.0:1788684070.336152:0:7960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.336200:0:7960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788684070.336480:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085685888 00000100:00100000:3.0:1788684070.336488:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085685888 00000100:00100000:3.0:1788684070.336544:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788684070.336554:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:7960:x1875571085685888:12345-0@lo:502: 00000100:00100000:3.0:1788684070.337190:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:7960:x1875571085685888:12345-0@lo:502: Request processed in 636us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684070.337199:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788684070.338175:0:7960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7960:1875571085685888:0@lo:502: 00000020:01000000:1.0:1788684070.338224:0:7960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684070.338235:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684070.338237:0:7960:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788684070.338243:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788684070.338247:0:7960:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:1.0:1788684070.338270:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788684070.338292:0:7960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d677e3e8000) 00000020:00000080:1.0:1788684070.338313:0:7960:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788684070.338319:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788684070.339080:0:7960:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788684070.339088:0:7960:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788684070.339097:0:7960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ac03c 00010000:00080000:1.0:1788684070.339130:0:7960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677cc8f000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1788684070.341070:0:7960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788684070.346897:0:7960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788684070.346911:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788684070.346948:0:7960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788684070.346970:0:7960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ac043 00000100:00080000:1.0:1788684070.346980:0:7960:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788684070.346986:0:7960:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d677cc8f000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684070.347023:0:7960:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6751bc3100 x1875571085686016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788684070.347051:0:7960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788684070.347130:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085686144:0@lo:400: 00000100:00100000:1.0:1788684070.347190:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.347222:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684070.347228:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085686272:0@lo:400: 00000100:00100000:1.0:1788684070.347253:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.347300:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085686400:0@lo:400: 00000100:00100000:1.0:1788684070.347324:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.347359:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085686144 00000100:00100000:2.0:1788684070.347577:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085686016:0@lo:38: 00000100:00100000:2.0:1788684070.347625:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.348486:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085686144 00000100:00100000:1.0:1788684070.348544:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085686400 00000100:00100000:1.0:1788684070.348548:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085686400 00000100:00100000:1.0:1788684070.348628:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788684070.348639:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085686144:12345-0@lo:400: 00000100:00100000:2.0:1788684070.348812:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788684070.348821:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788684070.361057:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788684070.361081:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684070.361096:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085686400:12345-0@lo:400: 00000100:00100000:0.0:1788684070.361197:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085686400:12345-0@lo:400: Request processed in 107us (13872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.361205:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684070.361235:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085686272 00000100:00100000:0.0:1788684070.361242:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085686272 00000100:00100000:0.0:1788684070.361269:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085686016 00000100:00100000:0.0:1788684070.361273:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085686016 00000100:00100000:0.0:1788684070.361282:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684070.361289:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085686272:12345-0@lo:400: 00000100:00100000:0.0:1788684070.361324:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085686272:12345-0@lo:400: Request processed in 36us (14071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.361330:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684070.361357:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684070.361362:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085686016:12345-0@lo:38: 00010000:00080000:0.0:1788684070.361414:0:6502:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1788684070.361449:0:6502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ac04a 00000004:00100000:0.0:1788684070.361464:0:6502:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788684070.361470:0:6502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:01000000:0.0:1788684070.361563:0:7960:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788684070.362717:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085686144:12345-0@lo:400: Request processed in 14065us (15512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.362729:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788684070.362942:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085686272:0@lo:400: 00010000:00080000:1.0:1788684070.362959:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6751bc0000 x1875571085686144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684070.362970:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085686144:0@lo:400: 00010000:00080000:2.0:1788684070.363833:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6751bc3b80 x1875571085686400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684070.363846:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085686400:0@lo:400: 00000020:01000000:0.0:1788684070.364585:0:7960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684070.364593:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684070.364595:0:7960:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788684070.364606:0:7960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684070.364610:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684070.364612:0:7960:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788684070.364615:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788684070.364617:0:7960:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788684070.364652:0:7960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7960:1875571085686528:0@lo:502: 00000100:00100000:0.0:1788684070.364833:0:7960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684070.364865:0:7960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238d80 going to sleep for 11 seconds 00000100:00080000:2.0:1788684070.364908:0:7964:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8d6775ef6a00 x1875571085686656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684070.364917:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788684070.364986:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085686528 00000100:00100000:1.0:1788684070.364992:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085686528 00000100:00100000:1.0:1788684070.365129:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788684070.365140:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:7960:x1875571085686528:12345-0@lo:502: 00000100:00100000:1.0:1788684070.365256:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:7960:x1875571085686528:12345-0@lo:502: Request processed in 117us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.367415:0:7960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7960:1875571085686528:0@lo:502: 00000020:01000000:0.0:1788684070.367461:0:7960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684070.367470:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684070.367472:0:7960:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788684070.367478:0:7960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788684070.368480:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788684070.368510:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788684070.368532:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.368544:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684070.368668:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684070.368670:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67466b4800 from 1 10000000:01000000:2.0:1788684070.368683:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684070.368716:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.368725:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.368735:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684070.368879:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085686784:0@lo:101: 00000100:00100000:2.0:1788684070.368938:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.368973:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684070.370469:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085686784 00000100:00100000:3.0:1788684070.370481:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085686784 00000100:00100000:3.0:1788684070.370545:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788684070.370556:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085686784:12345-0@lo:101: 00010000:00010000:3.0:1788684070.370692:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684070.370776:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac051 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684070.370804:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac051 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684070.370814:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac051 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684070.370823:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67820efc00, rc 0) 00000100:00100000:3.0:1788684070.370892:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085686784:12345-0@lo:101: Request processed in 338us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684070.370899:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788684070.372540:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085686784:0@lo:101: 00010000:00010000:2.0:1788684070.372573:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684070.372585:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684070.372662:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085686912:0@lo:501: 00000100:00100000:2.0:1788684070.372720:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.372760:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.373248:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085686912 00000100:00100000:0.0:1788684070.373255:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085686912 00000100:00100000:0.0:1788684070.373302:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788684070.373312:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085686912:12345-0@lo:501: 00000100:00100000:1.0:1788684070.376120:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788684070.376548:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085686912:12345-0@lo:501: Request processed in 3235us (3825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.376558:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788684070.376865:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085686912:0@lo:501: 00000100:00100000:2.0:1788684070.376917:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085687040:0@lo:503: 00000100:00100000:2.0:1788684070.376971:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.377007:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6d80 going to sleep for 11 seconds 00000100:00080000:1.0:1788684070.377156:0:6502:0:(import.c:65:import_set_state_nolock()) ffff8d677dfd0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684070.377209:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1875571085686016:12345-0@lo:38: Request processed in 15846us (29583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.377217:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684070.377280:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684070.377287:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788684070.377294:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788684070.377299:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788684070.377301:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc8f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788684070.377323:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000025e14d2): req@ffff8d6775ef6a00 x1875571085686656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684070.377342:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085686016:0@lo:38: 00000100:00100000:3.0:1788684070.377506:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085687040 00000100:00100000:3.0:1788684070.377512:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085687040 00000100:00100000:3.0:1788684070.377574:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788684070.377581:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085687040:12345-0@lo:503: 00000100:00100000:3.0:1788684070.377661:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085687040:12345-0@lo:503: Request processed in 80us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684070.377667:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788684070.378125:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684070.378168:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.378422:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684070.378432:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085687168:0@lo:41: 00000100:00100000:0.0:1788684070.378464:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684070.378494:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085686656 00000100:00100000:0.0:1788684070.378499:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085686656 00000100:00100000:0.0:1788684070.378519:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085687168 00000100:00100000:0.0:1788684070.378532:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085687168 00000100:00100000:0.0:1788684070.378548:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684070.378553:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7964:x1875571085686656:12345-0@lo:1000: 00000100:00100000:2.0:1788684070.378794:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085687040:0@lo:503: 00000100:00100000:0.0:1788684070.379005:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7964:x1875571085686656:12345-0@lo:1000: Request processed in 451us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.379013:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684070.379028:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684070.379034:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085687168:12345-0@lo:41: 00000004:00000024:0.0:1788684070.379054:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788684070.379088:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085687168:12345-0@lo:41: Request processed in 53us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.379094:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684070.379124:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085687168:0@lo:41: 00000100:00100000:2.0:1788684070.379514:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085686656:0@lo:1000: 00000040:01000000:2.0:1788684070.379554:0:7964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788684070.379665:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085687296:0@lo:1000: 00000100:00100000:2.0:1788684070.379779:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.379808:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.379863:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085687296 00000100:00100000:1.0:1788684070.379868:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085687296 00000100:00100000:1.0:1788684070.379906:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788684070.379913:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7964:x1875571085687296:12345-0@lo:1000: 00000100:00100000:1.0:1788684070.380020:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7964:x1875571085687296:12345-0@lo:1000: Request processed in 107us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.380026:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788684070.380240:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085687296:0@lo:1000: 00000100:00100000:2.0:1788684070.380277:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085687424:0@lo:700: 00000100:00100000:2.0:1788684070.380301:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.380328:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.380949:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085687424 00000100:00100000:0.0:1788684070.380955:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085687424 00000100:00100000:0.0:1788684070.381258:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788684070.381267:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7964:x1875571085687424:12345-0@lo:700: 00000100:00100000:0.0:1788684070.381351:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7964:x1875571085687424:12345-0@lo:700: Request processed in 72us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.381358:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684070.381793:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085687424:0@lo:700: 00000100:00100000:2.0:1788684070.381948:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085687552:0@lo:1000: 00000100:00100000:2.0:1788684070.381984:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.382011:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.382215:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085687552 00000100:00100000:1.0:1788684070.382220:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085687552 00000100:00100000:1.0:1788684070.382261:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684070.382269:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7964:x1875571085687552:12345-0@lo:1000: 00000100:00100000:1.0:1788684070.382328:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7964:x1875571085687552:12345-0@lo:1000: Request processed in 61us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.382335:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788684070.383032:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085687552:0@lo:1000: 00000004:00080000:2.0:1788684070.383084:0:7964:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8d677e2b6e40 with version 0 00000020:00100000:2.0:1788684070.383101:0:7964:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788684070.383107:0:7964:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d6775ef6a00 x1875571085687808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684070.383121:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085687808:0@lo:1000: 00000100:00100000:2.0:1788684070.383152:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.383178:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.383236:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085687808 00000100:00100000:1.0:1788684070.383241:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085687808 00000100:00100000:1.0:1788684070.383276:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684070.383284:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7964:x1875571085687808:12345-0@lo:1000: 00000100:00100000:2.0:1788684070.389755:0:7965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7965:1875571085687936:0@lo:502: 00000100:00100000:2.0:1788684070.389833:0:7965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.389869:0:7965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.390560:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085687936 00000100:00100000:1.0:1788684070.390578:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085687936 00000100:00100000:1.0:1788684070.390629:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788684070.390638:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:7965:x1875571085687936:12345-0@lo:502: 00000100:00100000:1.0:1788684070.390776:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:7965:x1875571085687936:12345-0@lo:502: Request processed in 138us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.390783:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788684070.391401:0:7965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7965:1875571085687936:0@lo:502: 00000001:00080000:3.0:1788684070.391435:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000020:01000000:2.0:1788684070.391436:0:7965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000001:00100000:3.0:1788684070.391446:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788684070.391448:0:7965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684070.391452:0:7965:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788684070.391461:0:7965:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67466b4800 00000020:00000080:2.0:1788684070.391464:0:7965:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788684070.391497:0:7965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7965:1875571085688064:0@lo:502: 00000100:00100000:2.0:1788684070.391548:0:7965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684070.391600:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085688064 00000100:00100000:3.0:1788684070.391606:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085688064 00000100:00100000:3.0:1788684070.391647:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788684070.391655:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:7965:x1875571085688064:12345-0@lo:502: 00000100:00100000:3.0:1788684070.393271:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:7965:x1875571085688064:12345-0@lo:502: Request processed in 1611us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684070.393283:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788684070.393976:0:7965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684070.394002:0:7965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:7965:1875571085688064:0@lo:502: 00000020:01000000:2.0:1788684070.394038:0:7965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684070.394047:0:7965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684070.394050:0:7965:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788684070.394057:0:7965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:1.0:1788684070.394459:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7964:x1875571085687808:12345-0@lo:1000: Request processed in 11173us (11303us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788684070.394483:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000000:0.0:1788684070.395291:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788684070.395317:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684070.395327:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.395347:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684070.395357:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788684070.395359:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d67482e3380 from 1 10000000:01000000:0.0:1788684070.395384:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788684070.395417:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.395425:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.395435:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684070.395452:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085688192:0@lo:101: 00000100:00100000:0.0:1788684070.395647:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684070.395716:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.395843:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085688192 00000100:00100000:1.0:1788684070.395851:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085688192 00000100:00100000:1.0:1788684070.395954:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788684070.395963:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085688192:12345-0@lo:101: 00010000:00010000:1.0:1788684070.395974:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684070.395985:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac05f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.396006:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac05f expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.396015:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac05f expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684070.396024:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d674148a200, rc 0) 00000100:00100000:1.0:1788684070.396245:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085688192:12345-0@lo:101: Request processed in 282us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684070.396251:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788684070.396314:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085688192:0@lo:101: 00010000:00010000:0.0:1788684070.396327:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.396433:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684070.396490:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085688320:0@lo:501: 00000100:00100000:0.0:1788684070.396613:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684070.396673:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.396700:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085688320 00000100:00100000:1.0:1788684070.396704:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085688320 00000100:00100000:1.0:1788684070.396830:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788684070.396838:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085688320:12345-0@lo:501: 00000100:00100000:1.0:1788684070.396985:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085688320:12345-0@lo:501: Request processed in 147us (370us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788684070.396992:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788684070.397036:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085688320:0@lo:501: 10000000:01000000:0.0:1788684070.397060:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788684070.397066:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684070.397073:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788684070.397638:0:7964:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788684070.397643:0:7964:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788684070.397664:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085687808:0@lo:1000: 00000100:00100000:2.0:1788684070.397729:0:7964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085688448:0@lo:1000: 00000100:00100000:2.0:1788684070.397773:0:7964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684070.397801:0:7964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684070.397954:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085688448 00000100:00100000:0.0:1788684070.397960:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085688448 00000100:00100000:0.0:1788684070.397997:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684070.398004:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7964:x1875571085688448:12345-0@lo:1000: 00000100:00100000:0.0:1788684070.398131:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7964:x1875571085688448:12345-0@lo:1000: Request processed in 127us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684070.398138:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684070.398176:0:7964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7964:1875571085688448:0@lo:1000: 00000040:00080000:2.0:1788684070.398193:0:7964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788684070.398220:0:7964:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8d677e2b6e40 with version 1 00000004:00080000:3.0:1788684070.398476:0:7961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8d677e2ba300 version 1 rpc_version 1 00000020:00100000:3.0:1788684070.398496:0:7961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788684070.398503:0:7961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8d6751b57800 x1875571085688704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684070.398519:0:7961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b57800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7961:1875571085688704:0@lo:1000: 00000100:00100000:3.0:1788684070.398871:0:7961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684070.398933:0:7961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684070.399053:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085688704 00000100:00100000:1.0:1788684070.399058:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085688704 00000100:00100000:1.0:1788684070.399132:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788684070.399141:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7961:x1875571085688704:12345-0@lo:1000: 00000001:00080000:3.0:1788684070.402149:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788684070.402979:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7961:x1875571085688704:12345-0@lo:1000: Request processed in 3835us (4125us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788684070.402993:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1788684070.403082:0:7961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788684070.403087:0:7961:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788684070.403103:0:7961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b57800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7961:1875571085688704:0@lo:1000: 00000040:00080000:2.0:1788684070.406055:0:7964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788684070.406139:0:7964:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788684070.406144:0:7964:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788684070.526416:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684071.038906:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085688832:0@lo:41: 00000100:00100000:0.0:1788684071.038971:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684071.038997:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085688832 00000100:00100000:2.0:1788684071.039005:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085688832 00000100:00100000:2.0:1788684071.039058:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684071.039069:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085688832:12345-0@lo:41: 00000004:00000024:2.0:1788684071.039101:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788684071.039205:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085688832:12345-0@lo:41: Request processed in 136us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684071.039212:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788684071.039310:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085688832:0@lo:41: 00010000:00010000:1.0:1788684071.551605:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684072.573975:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684073.597639:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684074.622654:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684075.645701:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085688960:0@lo:41: 00010000:00010000:3.0:1788684075.645811:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684075.645816:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684075.645939:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085688960 00000100:00100000:0.0:1788684075.645946:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085688960 00000100:00100000:0.0:1788684075.646001:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788684075.646011:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085688960:12345-0@lo:41: 00000004:00000024:0.0:1788684075.646044:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788684075.646111:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085688960:12345-0@lo:41: Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684075.646118:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788684075.646132:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085688960:0@lo:41: 00000100:00100000:0.0:1788684075.650448:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085689216:0@lo:400: 00000100:00100000:2.0:1788684075.650463:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085689088:0@lo:400: 00000100:00100000:2.0:1788684075.650531:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684075.650570:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684075.650608:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085689088 00000100:00100000:0.0:1788684075.650616:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085689344:0@lo:400: 00000100:00100000:1.0:1788684075.650617:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085689088 00000100:00100000:0.0:1788684075.650650:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684075.650678:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788684075.650684:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684075.650690:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:3623:x1875571085689088:12345-0@lo:400: 00000100:00100000:0.0:1788684075.650693:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085689472:0@lo:400: 00000100:00100000:1.0:1788684075.650743:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:3623:x1875571085689088:12345-0@lo:400: Request processed in 56us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684075.650747:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684075.650757:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788684075.650780:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085689216 00000100:00100000:0.0:1788684075.650785:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085689216 00000100:00100000:0.0:1788684075.650817:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085689472 00000100:00100000:0.0:1788684075.650821:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085689472 00000100:00100000:0.0:1788684075.650845:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684075.650851:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085689216:12345-0@lo:400: 00000100:00100000:0.0:1788684075.650885:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085689216:12345-0@lo:400: Request processed in 34us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684075.650892:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684075.650904:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684075.650910:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085689472:12345-0@lo:400: 00000100:00100000:0.0:1788684075.650936:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085689472:12345-0@lo:400: Request processed in 27us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684075.650942:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684075.650963:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085689344 00000100:00100000:0.0:1788684075.650966:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085689344 00000100:00100000:0.0:1788684075.650987:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788684075.650994:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085689344:12345-0@lo:400: 00000100:00100000:0.0:1788684075.651033:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085689344:12345-0@lo:400: Request processed in 40us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684075.651039:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788684075.651077:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6780031f80 x1875571085689472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684075.651089:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085689472:0@lo:400: 00000100:00100000:0.0:1788684075.651109:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085689344:0@lo:400: 00010000:00080000:0.0:1788684075.651134:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6780032300 x1875571085689216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684075.651142:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085689216:0@lo:400: 00000100:00100000:2.0:1788684075.651178:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085689088:0@lo:400: 00000100:00100000:2.0:1788684076.166241:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085689600:0@lo:41: 00000100:00100000:2.0:1788684076.166313:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684076.169938:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085689600 00000100:00100000:1.0:1788684076.169950:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085689600 00000100:00100000:1.0:1788684076.170015:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788684076.170026:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085689600:12345-0@lo:41: 00000004:00000024:1.0:1788684076.170059:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788684076.170166:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085689600:12345-0@lo:41: Request processed in 142us (3852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684076.170174:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684076.170349:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085689600:0@lo:41: 00010000:00010000:0.0:1788684076.675945:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788684077.407897:0:8404:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788684077.407900:0:8404:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788684077.407902:0:8404:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788684077.408032:0:8404:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d677e122800 00000020:01000004:2.0:1788684077.408047:0:8404:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788684077.408059:0:8404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788684077.408072:0:8404:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d677e144d40) 00000020:00000080:2.0:1788684077.408085:0:8404:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788684077.475201:0:8404:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788684077.475255:0:8404:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788684077.501307:0:8404:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788684077.501809:0:8404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788684077.501820:0:8404:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788684077.501830:0:8404:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x44bac02bd54ac074 00000020:01000004:2.0:1788684077.501837:0:8404:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788684077.501856:0:8404:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788684077.501859:0:8404:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788684077.501865:0:8404:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788684077.501869:0:8404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788684077.501880:0:8404:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d677e143380) 00000020:00000080:2.0:1788684077.501890:0:8404:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788684077.505143:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684077.505349:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788684077.505383:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788684077.506263:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788684077.506271:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788684077.512511:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788684077.512523:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788684077.514148:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788684077.514330:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788684077.514336:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788684077.516928:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788684077.516939:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788684077.541846:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788684077.542080:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788684077.542087:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788684077.544598:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788684077.544611:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788684077.545206:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788684077.545215:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788684077.549807:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684077.549992:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788684077.549998:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788684077.550773:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788684077.550780:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788684077.594576:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788684077.594768:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788684077.594775:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788684077.595763:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788684077.595772:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788684077.596131:0:8404:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788684077.596157:0:8404:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788684077.596163:0:8404:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788684077.614048:0:8404:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788684077.614087:0:8404:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788684077.614091:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788684077.614093:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788684077.614095:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684077.614096:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684077.614097:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684077.614098:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684077.614100:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788684077.614101:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788684077.614103:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788684077.614104:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684077.614106:0:8404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788684077.614109:0:8404:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788684077.614111:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788684077.614113:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788684077.614114:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684077.614120:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684077.614121:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684077.614122:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684077.614123:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788684077.614124:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788684077.614125:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788684077.614126:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684077.614127:0:8404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788684077.614151:0:8404:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788684077.614168:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085689728:0@lo:253: 00000100:00100000:0.0:1788684077.614230:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.614331:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750a08c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684077.614591:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085689728 00000100:00100000:1.0:1788684077.614598:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085689728 00000100:00100000:1.0:1788684077.614691:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788684077.614700:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:8404:x1875571085689728:12345-0@lo:253: 20000000:01000000:1.0:1788684077.614749:0:6489:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788684077.614753:0:6489:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788684077.614757:0:6489:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788684077.614760:0:6489:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788684077.614914:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684077.615036:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788684077.615049:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788684077.615065:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788684077.615070:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788684077.615083:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788684077.615098:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788684077.615168:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788684077.615181:0:6489:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:1.0:1788684077.615183:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:1.0:1788684077.615194:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788684077.615199:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788684077.615210:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788684077.615215:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:1.0:1788684077.615225:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788684077.615231:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788684077.615242:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788684077.615254:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788684077.615310:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788684077.615319:0:6489:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:1.0:1788684077.615321:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:1.0:1788684077.615332:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788684077.615336:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788684077.615402:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788684077.615410:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:1.0:1788684077.615423:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788684077.615428:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788684077.615440:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788684077.615456:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788684077.615822:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788684077.615834:0:6489:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:1.0:1788684077.615835:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:1.0:1788684077.615856:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788684077.615862:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788684077.615873:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788684077.615877:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:1.0:1788684077.615887:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788684077.615892:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788684077.615902:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788684077.615915:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788684077.615926:0:6489:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788684077.615929:0:6489:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788684077.615932:0:6489:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788684077.615970:0:6489:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788684077.615973:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788684077.617013:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788684077.617054:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788684077.617071:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788684077.617273:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788684077.617295:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788684077.617308:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788684077.617320:0:6489:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788684077.617322:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788684077.617708:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788684077.617726:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788684077.617738:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788684077.617874:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788684077.617891:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788684077.617903:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788684077.617910:0:6489:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788684077.617912:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788684077.618221:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788684077.618924:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788684077.618954:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788684077.618969:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788684077.618981:0:6489:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788684077.618983:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788684077.619385:0:8426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788684077.619410:0:8426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788684077.619426:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788684077.619572:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788684077.619591:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788684077.619606:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1788684077.619619:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788684077.619636:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619654:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54abf4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abf47 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619662:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d674148b600/0x44bac02bd54abfc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abfbe expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619669:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac00b expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619682:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac027 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619689:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac05f expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619697:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619745:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac05f expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619759:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac05f expref: 18 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.619773:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085689856:0@lo:104: 00000100:00100000:2.0:1788684077.619827:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684077.619870:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac027 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619879:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac027 expref: 18 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.619886:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085689984:0@lo:104: 00000100:00100000:2.0:1788684077.619915:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684077.619951:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac00b expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.619960:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac00b expref: 18 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.619974:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085690112:0@lo:104: 00000100:00100000:2.0:1788684077.620004:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684077.620020:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d674148b600/0x44bac02bd54abfc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abfbe expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.620029:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d674148b600/0x44bac02bd54abfc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abfbe expref: 18 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.620037:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085690240:0@lo:104: 00000100:00100000:2.0:1788684077.620054:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684077.620070:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54abf4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abf47 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.620078:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54abf4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abf47 expref: 18 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.620086:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085690368:0@lo:104: 00000100:00100000:2.0:1788684077.620104:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684077.620114:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677724d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684077.620318:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085689856 00000100:00100000:0.0:1788684077.620324:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085689856 00000100:00100000:0.0:1788684077.620354:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085689984 00000100:00100000:0.0:1788684077.620357:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085689984 00000100:00100000:0.0:1788684077.620396:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085690112 00000100:00100000:0.0:1788684077.620400:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085690112 00000100:00100000:0.0:1788684077.620411:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085690240 00000100:00100000:0.0:1788684077.620413:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085690240 00000100:00100000:0.0:1788684077.620420:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085690368 00000100:00100000:0.0:1788684077.620422:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085690368 00000100:00100000:0.0:1788684077.620434:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684077.620441:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+7:6489:x1875571085689856:12345-0@lo:104: 00010000:00010000:0.0:1788684077.620455:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620513:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684077.620519:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+7:6489:x1875571085689856:12345-0@lo:104: Request processed in 79us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.620526:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684077.620542:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684077.620547:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:6489:x1875571085689984:12345-0@lo:104: 00010000:00010000:0.0:1788684077.620561:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620594:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788684077.620600:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:6489:x1875571085689984:12345-0@lo:104: Request processed in 53us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.620606:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684077.620617:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684077.620623:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:6489:x1875571085690112:12345-0@lo:104: 00010000:00010000:0.0:1788684077.620630:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620653:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788684077.620657:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:6489:x1875571085690112:12345-0@lo:104: Request processed in 35us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.620662:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684077.620671:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684077.620676:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6489:x1875571085690240:12345-0@lo:104: 00010000:00010000:0.0:1788684077.620683:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67820ee400/0x44bac02bd54abfbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620703:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788684077.620707:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6489:x1875571085690240:12345-0@lo:104: Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.620712:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684077.620720:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684077.620725:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6489:x1875571085690368:12345-0@lo:104: 00010000:00010000:0.0:1788684077.620737:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54abf47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620760:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788684077.620764:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6489:x1875571085690368:12345-0@lo:104: Request processed in 39us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.620769:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788684077.620784:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788684077.620790:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620796:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740031600 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684077.620800:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620808:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684077.620816:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684077.620821:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788684077.620847:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620853:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684077.620868:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620875:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740031600/0x44bac02bd54ac05f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac066 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620892:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788684077.620896:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620902:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a7400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684077.620905:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620912:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684077.620918:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684077.620923:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788684077.620936:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620941:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684077.620953:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620959:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a7400/0x44bac02bd54ac027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac02e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620969:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788684077.620972:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620986:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d674148b200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684077.620989:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.620996:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684077.621002:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684077.621007:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788684077.621020:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621025:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684077.621030:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621036:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac00b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac012 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621049:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684077.621052:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67820ee400/0x44bac02bd54abfbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621057:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67820ee400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684077.621059:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67820ee400/0x44bac02bd54abfbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621075:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67820ee400/0x44bac02bd54abfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684077.621082:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67820ee400/0x44bac02bd54abfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684077.621087:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788684077.621100:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67820ee400/0x44bac02bd54abfbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621105:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684077.621110:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67820ee400/0x44bac02bd54abfbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621115:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67820ee400/0x44bac02bd54abfbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abfc5 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621124:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684077.621127:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54abf47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621132:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a7000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684077.621135:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54abf47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621141:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54abf47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684077.621147:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54abf47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684077.621157:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788684077.621169:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54abf47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621175:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684077.621178:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54abf47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621184:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54abf47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abf4e expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621195:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684077.621197:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684077.621198:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684077.621205:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684077.621221:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085690496:0@lo:103: 00000100:00100000:0.0:1788684077.621260:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.621286:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085691008:0@lo:103: 00000100:00100000:0.0:1788684077.621302:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.621320:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684077.621324:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085690880:0@lo:103: 00000100:00100000:0.0:1788684077.621340:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.621360:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085690624:0@lo:103: 00000100:00100000:0.0:1788684077.621403:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.621417:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684077.621422:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085690752:0@lo:103: 00000100:00100000:0.0:1788684077.621442:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.621473:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085690496 00000100:00100000:0.0:1788684077.621478:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085690496 00010000:00010000:0.0:1788684077.621509:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac05f expref: 19 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684077.621524:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085691008 00000100:00100000:0.0:1788684077.621527:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085691008 00010000:00010000:0.0:1788684077.621536:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54abf4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abf47 expref: 20 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684077.621545:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085690880 00000100:00100000:0.0:1788684077.621547:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085690880 00010000:00010000:0.0:1788684077.621555:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d674148b600/0x44bac02bd54abfc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abfbe expref: 21 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684077.621564:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085690624 00000100:00100000:0.0:1788684077.621567:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085690624 00010000:00010000:0.0:1788684077.621575:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac027 expref: 22 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684077.621584:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085690752 00000100:00100000:0.0:1788684077.621586:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085690752 00010000:00010000:0.0:1788684077.621595:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac00b expref: 23 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684077.621607:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684077.621612:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3624:x1875571085690496:12345-0@lo:103: 00010000:00010000:0.0:1788684077.621621:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684077.621626:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac05f expref: 23 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621636:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac05f expref: 23 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621655:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684077.621682:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3624:x1875571085690496:12345-0@lo:103: Request processed in 70us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.621689:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684077.621701:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684077.621707:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3624:x1875571085691008:12345-0@lo:103: 00010000:00010000:0.0:1788684077.621713:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684077.621718:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54abf4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abf47 expref: 22 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621725:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54abf4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abf47 expref: 22 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621734:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684077.621752:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3624:x1875571085691008:12345-0@lo:103: Request processed in 46us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.621758:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684077.621767:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684077.621772:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3624:x1875571085690880:12345-0@lo:103: 00010000:00010000:0.0:1788684077.621787:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684077.621792:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d674148b600/0x44bac02bd54abfc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abfbe expref: 21 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621800:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d674148b600/0x44bac02bd54abfc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abfbe expref: 21 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621808:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684077.621831:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3624:x1875571085690880:12345-0@lo:103: Request processed in 58us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.621837:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684077.621848:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684077.621853:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:3625:x1875571085690624:12345-0@lo:103: 00010000:00010000:0.0:1788684077.621859:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684077.621863:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac027 expref: 20 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621871:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac027 expref: 20 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621879:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684077.621900:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:3625:x1875571085690624:12345-0@lo:103: Request processed in 46us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.621905:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684077.621915:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684077.621921:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:3625:x1875571085690752:12345-0@lo:103: 00010000:00010000:0.0:1788684077.621927:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684077.621931:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac00b expref: 19 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621938:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac00b expref: 19 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621948:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621956:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621975:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621982:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621988:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.621995:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.622000:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a6400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684077.622004:0:6482:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.622010:0:6482:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.622018:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.622026:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684077.622048:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:3625:x1875571085690752:12345-0@lo:103: Request processed in 127us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.622053:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684077.622106:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085690752:0@lo:103: 00000100:00100000:0.0:1788684077.622115:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085690624:0@lo:103: 00000100:00100000:0.0:1788684077.622136:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085690880:0@lo:103: 00000100:00100000:0.0:1788684077.622151:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085690496:0@lo:103: 00000100:00100000:0.0:1788684077.622157:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085691008:0@lo:103: 00010000:00010000:2.0:1788684077.622314:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac05f expref: 18 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.622325:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085689856:0@lo:104: 00010000:00010000:2.0:1788684077.622334:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67820efa00/0x44bac02bd54ac02e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac027 expref: 17 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.622341:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085689984:0@lo:104: 00010000:00010000:2.0:1788684077.622348:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030600/0x44bac02bd54ac012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac00b expref: 16 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.622362:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085690112:0@lo:104: 00010000:00010000:2.0:1788684077.622399:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148b600/0x44bac02bd54abfc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abfbe expref: 15 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.622410:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085690240:0@lo:104: 00010000:00010000:2.0:1788684077.622418:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54abf4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abf47 expref: 14 pid: 6491 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.622426:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085690368:0@lo:104: 00010000:00010000:2.0:1788684077.622446:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.622456:0:6489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.622462:0:6489:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.622468:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac082 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788684077.622481:0:6489:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788684077.624359:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:8404:x1875571085689728:12345-0@lo:253: Request processed in 9653us (10122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684077.624398:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788684077.624584:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085689728:0@lo:253: 10000000:01000000:0.0:1788684077.624599:0:8404:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788684077.624602:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788684077.624604:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788684077.624606:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684077.624607:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788684077.624609:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684077.624610:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684077.624611:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788684077.624613:0:8404:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788684077.624614:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684077.624615:0:8404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788684077.624634:0:8404:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d677e122800 from lustre-OST0000 10000000:01000000:0.0:1788684077.624659:0:8404:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788684077.624662:0:8404:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788684077.624669:0:8404:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d67482e3380 local copy 10000000:01000000:0.0:1788684077.624674:0:8404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788684077.624703:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.624713:0:8404:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.624723:0:8404:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684077.624739:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691136:0@lo:101: 00000100:00100000:0.0:1788684077.624770:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.624844:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684077.624954:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085691136 00000100:00100000:2.0:1788684077.624960:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085691136 00000100:00100000:2.0:1788684077.625030:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788684077.625044:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+13:8404:x1875571085691136:12345-0@lo:101: 00010000:00010000:2.0:1788684077.625056:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684077.625068:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac089 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.625088:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac089 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.625098:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac089 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.625106:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67560a6800, rc 0) 00000100:00100000:2.0:1788684077.625177:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:8404:x1875571085691136:12345-0@lo:101: Request processed in 133us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684077.625184:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788684077.625258:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691136:0@lo:101: 00010000:00010000:0.0:1788684077.625270:0:8404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.625280:0:8404:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684077.625362:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691264:0@lo:501: 00000100:00100000:0.0:1788684077.625561:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.625590:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684077.625630:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085691264 00000100:00100000:1.0:1788684077.625635:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085691264 00000100:00100000:1.0:1788684077.625702:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788684077.625709:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:8404:x1875571085691264:12345-0@lo:501: 00000100:00100000:1.0:1788684077.625769:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:8404:x1875571085691264:12345-0@lo:501: Request processed in 61us (207us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788684077.625776:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788684077.625904:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691264:0@lo:501: 10000000:01000000:0.0:1788684077.625917:0:8404:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788684077.625936:0:8404:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788684077.625941:0:8404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.625949:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.625955:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.625979:0:8404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788684077.626000:0:8404:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d677e122800 10000000:01000000:0.0:1788684077.626005:0:8404:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788684077.626009:0:8404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788684077.626012:0:8404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684077.626016:0:8404:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788684077.626024:0:8404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788684077.626041:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.626048:0:8404:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.626055:0:8404:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684077.626067:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691392:0@lo:101: 00000100:00100000:0.0:1788684077.626092:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.626114:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085691392 00000100:00100000:0.0:1788684077.626117:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085691392 00000100:00100000:0.0:1788684077.626134:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788684077.626139:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:8404:x1875571085691392:12345-0@lo:101: 00010000:00010000:0.0:1788684077.626146:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684077.626154:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac097 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.626167:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac097 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.626175:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac097 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.626181:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740030400, rc 0) 00000100:00100000:0.0:1788684077.626202:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085691392:12345-0@lo:101: Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.626207:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788684077.626234:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684077.626245:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691392:0@lo:101: 00010000:00010000:0.0:1788684077.626255:0:8404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.626263:0:8404:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684077.626307:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691520:0@lo:501: 00000100:00100000:0.0:1788684077.626328:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.626344:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085691520 00000100:00100000:0.0:1788684077.626361:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085691520 00000100:00100000:0.0:1788684077.626405:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788684077.626410:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085691520:12345-0@lo:501: 00000100:00100000:0.0:1788684077.626496:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085691520:12345-0@lo:501: Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.626503:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788684077.626529:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684077.626541:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691520:0@lo:501: 00000100:00100000:0.0:1788684077.626576:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691648:0@lo:503: 00000100:00100000:0.0:1788684077.626612:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.626631:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085691648 00000100:00100000:0.0:1788684077.626635:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085691648 00000100:00100000:0.0:1788684077.626650:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788684077.626655:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085691648:12345-0@lo:503: 00010000:00010000:1.0:1788684077.626916:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684077.626923:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.626931:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740031a00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684077.626934:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.626941:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684077.626948:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684077.626954:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684077.626973:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.626980:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684077.627002:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.627008:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x44bac02bd54ac090 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.627021:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684077.627022:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684077.627024:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684077.627184:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085691776:0@lo:103: 00000100:00100000:0.0:1788684077.627222:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.627309:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085691648:12345-0@lo:503: Request processed in 652us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.627316:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788684077.627357:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684077.627393:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691648:0@lo:503: 00000040:00080000:0.0:1788684077.627614:0:8404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788684077.627680:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691904:0@lo:502: 00000100:00100000:0.0:1788684077.627715:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.627736:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684077.627839:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085691904 00000100:00100000:3.0:1788684077.627844:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085691904 00000100:00100000:3.0:1788684077.627879:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788684077.627887:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085691904:12345-0@lo:502: 00000100:00100000:3.0:1788684077.627962:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085691904:12345-0@lo:502: Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684077.627968:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788684077.628144:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085691904:0@lo:502: 00000040:00080000:0.0:1788684077.628297:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788684077.628319:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788684077.628331:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788684077.628343:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788684077.628511:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788684077.628531:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788684077.628552:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692032:0@lo:502: 00000100:00100000:0.0:1788684077.628590:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.628616:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684077.628664:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085692032 00000100:00100000:3.0:1788684077.628669:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085692032 00000100:00100000:3.0:1788684077.628700:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788684077.628706:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692032:12345-0@lo:502: 00000100:00100000:3.0:1788684077.628780:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692032:12345-0@lo:502: Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684077.628787:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788684077.628884:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692032:0@lo:502: 00000040:00080000:0.0:1788684077.628918:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788684077.628925:0:8404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788684077.629305:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788684077.629313:0:8427:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788684077.629319:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684077.629321:0:8427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788684077.629328:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684077.629344:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d677cf28000) 00000020:00000080:3.0:1788684077.629394:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788684077.629402:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788684077.629463:0:8427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d677e122800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788684077.629471:0:8427:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788684077.629478:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x44bac02bd54ac0ac 00000100:00100000:1.0:1788684077.632471:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085691776 00000100:00100000:1.0:1788684077.632493:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085691776 00000100:00100000:1.0:1788684077.632555:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684077.632565:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3625:x1875571085691776:12345-0@lo:103: 00010000:00010000:1.0:1788684077.632587:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684077.632605:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac089 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.632621:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684077.632739:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:3625:x1875571085691776:12345-0@lo:103: Request processed in 176us (5516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684077.632747:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684077.637502:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085691776:0@lo:103: 00010000:00010000:3.0:1788684077.637831:0:8427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788684077.638852:0:8427:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788684077.641165:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788684077.641931:0:8427:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788684077.645565:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788684077.645735:0:8427:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788684077.650169:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788684077.651463:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788684077.651474:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684077.651480:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684077.651482:0:8427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788684077.651494:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684077.651499:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684077.651500:0:8427:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684077.651503:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684077.651505:0:8427:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788684077.651524:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684077.651527:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684077.651528:0:8427:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788684077.651531:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788684077.651688:0:8404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788684077.651717:0:8404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788684077.651734:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.651746:0:8404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684077.651753:0:8404:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677e122800 from 1 10000000:01000000:1.0:1788684077.651757:0:8404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788684077.651789:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.651797:0:8404:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.651808:0:8404:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684077.651828:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692160:0@lo:101: 00000100:00100000:1.0:1788684077.651885:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684077.651924:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684077.655530:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085692160 00000100:00100000:0.0:1788684077.655542:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085692160 00000100:00100000:0.0:1788684077.655589:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788684077.655599:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:8404:x1875571085692160:12345-0@lo:101: 00010000:00010000:0.0:1788684077.655622:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684077.655639:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac0b3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.655665:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac0b3 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.655677:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac0b3 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684077.655686:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740031600, rc 0) 00000100:00100000:0.0:1788684077.655757:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692160:12345-0@lo:101: Request processed in 160us (3872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.655764:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788684077.655850:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692160:0@lo:101: 00010000:00010000:1.0:1788684077.655867:0:8404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.655878:0:8404:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684077.655974:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692288:0@lo:501: 00000100:00100000:1.0:1788684077.656008:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684077.656045:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684077.656091:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085692288 00000100:00100000:0.0:1788684077.656096:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085692288 00000100:00100000:0.0:1788684077.656125:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788684077.656132:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692288:12345-0@lo:501: 00000100:00100000:0.0:1788684077.656213:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692288:12345-0@lo:501: Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.656221:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788684077.656281:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692288:0@lo:501: 00000100:00100000:1.0:1788684077.656305:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692416:0@lo:503: 00000100:00100000:1.0:1788684077.656344:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684077.656399:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684077.656525:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085692416 00000100:00100000:0.0:1788684077.656529:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085692416 00000100:00100000:0.0:1788684077.656552:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788684077.656558:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692416:12345-0@lo:503: 00000100:00100000:0.0:1788684077.656636:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692416:12345-0@lo:503: Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.656643:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788684077.656986:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692416:0@lo:503: 00000040:00080000:1.0:1788684077.657200:0:8404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788684077.657266:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692544:0@lo:502: 00000100:00100000:1.0:1788684077.657303:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684077.657325:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684077.658738:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085692544 00000100:00100000:2.0:1788684077.658748:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085692544 00000100:00100000:2.0:1788684077.658789:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788684077.658797:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692544:12345-0@lo:502: 00000100:00100000:2.0:1788684077.658920:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692544:12345-0@lo:502: Request processed in 123us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684077.658927:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788684077.659417:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692544:0@lo:502: 00000040:00080000:1.0:1788684077.659644:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788684077.659671:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788684077.659696:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692672:0@lo:502: 00000100:00100000:1.0:1788684077.659735:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684077.659763:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684077.659921:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085692672 00000100:00100000:2.0:1788684077.659926:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085692672 00000100:00100000:2.0:1788684077.659958:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788684077.659965:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692672:12345-0@lo:502: 00000100:00100000:2.0:1788684077.660037:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692672:12345-0@lo:502: Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684077.660049:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788684077.660087:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692672:0@lo:502: 00000040:00080000:2.0:1788684077.660125:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788684077.660133:0:8404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788684077.660719:0:8431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684077.660727:0:8431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684077.660729:0:8431:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788684077.660735:0:8431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d677e122800 00000020:00000080:1.0:1788684077.660737:0:8431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788684077.660746:0:8431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684077.660749:0:8431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684077.660750:0:8431:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788684077.660752:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788684077.660918:0:8404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788684077.660937:0:8404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684077.660984:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.660996:0:8404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684077.661041:0:8404:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788684077.661044:0:8404:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d677e122800 10000000:01000000:2.0:1788684077.661046:0:8404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d677e122800 10000000:01000000:2.0:1788684077.661050:0:8404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788684077.661055:0:8404:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d677e122800 from 1 10000000:01000000:2.0:1788684077.661058:0:8404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788684077.661082:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.661090:0:8404:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.661100:0:8404:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.661115:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692800:0@lo:101: 00000100:00100000:2.0:1788684077.661150:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684077.661182:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085692800 00000100:00100000:2.0:1788684077.661187:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085692800 00000100:00100000:2.0:1788684077.661220:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788684077.661227:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085692800:12345-0@lo:101: 00010000:00010000:2.0:1788684077.661236:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684077.661246:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac0c1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.661264:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac0c1 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.661274:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac0c1 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.661282:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67560a7e00, rc 0) 00000100:00100000:2.0:1788684077.661305:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085692800:12345-0@lo:101: Request processed in 79us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684077.661311:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788684077.661341:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684077.661474:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692800:0@lo:101: 00010000:00010000:2.0:1788684077.661498:0:8404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.661507:0:8404:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.661568:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692928:0@lo:501: 00000100:00100000:2.0:1788684077.661592:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684077.661644:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684077.661741:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085692928 00000100:00100000:1.0:1788684077.661745:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085692928 00000100:00100000:1.0:1788684077.661774:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788684077.661780:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085692928:12345-0@lo:501: 00000100:00100000:1.0:1788684077.661855:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085692928:12345-0@lo:501: Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684077.661861:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788684077.661967:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085692928:0@lo:501: 00000100:00100000:2.0:1788684077.661993:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085693056:0@lo:503: 00000100:00100000:2.0:1788684077.662026:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684077.662042:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684077.662081:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085693056 00000100:00100000:1.0:1788684077.662085:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085693056 00000100:00100000:1.0:1788684077.662112:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788684077.662118:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085693056:12345-0@lo:503: 00000100:00100000:1.0:1788684077.662182:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085693056:12345-0@lo:503: Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684077.662188:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788684077.662253:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085693056:0@lo:503: 00000040:00080000:2.0:1788684077.662479:0:8404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788684077.662551:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085693184:0@lo:502: 00000100:00100000:2.0:1788684077.662584:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684077.662601:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684077.662691:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085693184 00000100:00100000:1.0:1788684077.662695:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085693184 00000100:00100000:1.0:1788684077.662723:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684077.662730:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085693184:12345-0@lo:502: 00000100:00100000:1.0:1788684077.662810:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085693184:12345-0@lo:502: Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684077.662825:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788684077.662890:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085693184:0@lo:502: 00000040:00080000:0.0:1788684077.663045:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788684077.663069:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788684077.663082:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788684077.663096:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788684077.663110:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788684077.663122:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788684077.663133:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788684077.663144:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788684077.663155:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788684077.663167:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788684077.663179:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788684077.663190:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788684077.663201:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788684077.663212:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788684077.663222:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788684077.663234:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788684077.663245:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788684077.663256:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788684077.663267:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788684077.663278:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788684077.663289:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788684077.663301:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788684077.663311:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788684077.663324:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788684077.663335:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788684077.663346:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788684077.663357:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788684077.663404:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788684077.663419:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788684077.663445:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788684077.663461:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788684077.663482:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788684077.663508:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788684077.663520:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788684077.663534:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788684077.663545:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788684077.663557:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788684077.663581:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085693312:0@lo:502: 00000100:00100000:0.0:1788684077.663621:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.663651:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684077.663791:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085693312 00000100:00100000:1.0:1788684077.663796:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085693312 00000100:00100000:1.0:1788684077.663819:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788684077.663826:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085693312:12345-0@lo:502: 00000100:00100000:1.0:1788684077.663907:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085693312:12345-0@lo:502: Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684077.663913:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788684077.664025:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085693312:0@lo:502: 00000040:00080000:0.0:1788684077.664065:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788684077.664073:0:8404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788684077.664581:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788684077.664595:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d6750b7cd40) 00000020:00000080:0.0:1788684077.664614:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788684077.664687:0:8432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d677e122800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788684077.664691:0:8432:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d677e122800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788684077.664694:0:8432:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677e122800 3 00010000:00080000:0.0:1788684077.664720:0:8432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d678003d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1788684077.666576:0:8432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788684077.666754:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788684077.666790:0:8432:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788684077.666800:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x44bac02bd54ac0d6 00000100:00080000:0.0:1788684077.666808:0:8432:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788684077.666813:0:8432:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d678003d800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684077.666841:0:8432:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6780032300 x1875571085693440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684077.666865:0:8432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1788684077.667013:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788684077.667036:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d66465e4d40) 00000020:00000080:0.0:1788684077.667049:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788684077.667109:0:8432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d677e122800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788684077.667113:0:8432:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d677e122800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788684077.667116:0:8432:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677e122800 3 00010000:00080000:0.0:1788684077.667139:0:8432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d678003c000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.144@tcp at head 00000100:00100000:3.0:1788684077.667639:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085693440:0@lo:38: 00000100:00100000:3.0:1788684077.667697:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684077.667800:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085693440 00000100:00100000:3.0:1788684077.667806:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085693440 00000100:00100000:3.0:1788684077.667831:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788684077.667839:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085693440:12345-0@lo:38: 00010000:00080000:3.0:1788684077.667864:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:3.0:1788684077.667895:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x44bac02bd54ac0e4 00000004:00100000:3.0:1788684077.667908:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788684077.667935:0:6498:0:(import.c:65:import_set_state_nolock()) ffff8d6645991800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684077.667979:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875571085693440:12345-0@lo:38: Request processed in 139us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684077.667986:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788684077.668007:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085693568:0@lo:400: 00000100:00100000:3.0:1788684077.668033:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684077.668052:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684077.668057:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085693952:0@lo:400: 00000100:00100000:3.0:1788684077.668081:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684077.668108:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085693696:0@lo:400: 00000100:00100000:3.0:1788684077.668130:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684077.668143:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684077.668149:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085693824:0@lo:400: 00000100:00100000:3.0:1788684077.668166:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684077.668190:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085693568 00000100:00100000:3.0:1788684077.668194:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085693568 00000100:00100000:3.0:1788684077.668215:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085693824 00000100:00100000:3.0:1788684077.668218:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085693824 00000100:00100000:3.0:1788684077.668229:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684077.668235:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085693568:12345-0@lo:400: 00000100:00100000:3.0:1788684077.668266:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085693568:12345-0@lo:400: Request processed in 31us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684077.668273:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684077.668284:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684077.668296:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085693824:12345-0@lo:400: 00000100:00100000:3.0:1788684077.668324:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085693824:12345-0@lo:400: Request processed in 28us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684077.668330:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788684077.668359:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6780032300 x1875571085693440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684077.668387:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788684077.668395:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788684077.668401:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788684077.668406:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788684077.668407:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d678003d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788684077.668413:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085693440:0@lo:38: 00000100:00100000:3.0:1788684077.668438:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085693952 00000100:00100000:3.0:1788684077.668442:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085693952 00000100:00100000:3.0:1788684077.668457:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085693696 00000100:00100000:3.0:1788684077.668460:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085693696 00000100:00100000:3.0:1788684077.668470:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684077.668475:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085693952:12345-0@lo:400: 00000100:00100000:3.0:1788684077.668518:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085693952:12345-0@lo:400: Request processed in 42us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684077.668525:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684077.668536:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684077.668542:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085693696:12345-0@lo:400: 00000100:00100000:3.0:1788684077.668566:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085693696:12345-0@lo:400: Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684077.668572:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684077.668607:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085693952:0@lo:400: 00010000:00080000:3.0:1788684077.668617:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6751b56680 x1875571085693568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684077.668625:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085693568:0@lo:400: 00010000:00080000:3.0:1788684077.668644:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6751b54000 x1875571085693824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684077.668652:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085693824:0@lo:400: 00000100:00100000:3.0:1788684077.668660:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085693696:0@lo:400: 00010000:00010000:0.0:1788684077.676116:0:8432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1788684077.676323:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788684077.676397:0:8432:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788684077.676408:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x44bac02bd54ac0eb 00000100:00080000:0.0:1788684077.676418:0:8432:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788684077.676424:0:8432:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d678003c000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684077.676458:0:8432:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6780031500 x1875571085694080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684077.676480:0:8432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788684077.677200:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085694080:0@lo:38: 00000100:00100000:1.0:1788684077.677266:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684077.677361:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085694080 00000100:00100000:0.0:1788684077.677406:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085694080 00000100:00100000:0.0:1788684077.677440:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684077.677447:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085694080:12345-0@lo:38: 00010000:00080000:0.0:1788684077.677471:0:6497:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:0.0:1788684077.677531:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x44bac02bd54ac0f2 00000004:00100000:0.0:1788684077.677545:0:6497:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788684077.677579:0:6497:0:(import.c:65:import_set_state_nolock()) ffff8d664672e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684077.677630:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875571085694080:12345-0@lo:38: Request processed in 182us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684077.677637:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788684077.677685:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6780031500 x1875571085694080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684077.678154:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684077.678161:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788684077.678169:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788684077.678175:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788684077.678177:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d678003c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788684077.678183:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085694080:0@lo:38: 00000040:00080000:0.0:1788684077.681446:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788684077.681667:0:8404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788684077.681698:0:8404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788684077.681721:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684077.681733:0:8404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788684077.681775:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788684077.681778:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788684077.681779:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684077.681781:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684077.681782:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684077.681783:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684077.681785:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684077.681786:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684077.681788:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684077.681790:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684077.681791:0:8404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684077.681794:0:8404:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788684077.681797:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684077.681798:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788684077.681804:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684077.681805:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684077.681806:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684077.681807:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684077.681808:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684077.681809:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684077.681810:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684077.681811:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684077.681812:0:8404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684077.681835:0:8404:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788684077.681850:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085694208:0@lo:253: 00000100:00100000:3.0:1788684077.681909:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684077.681943:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748270540 going to sleep for 11 seconds 00000100:00100000:3.0:1788684077.681964:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085694208 00000100:00100000:3.0:1788684077.681971:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085694208 00000100:00100000:3.0:1788684077.682006:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788684077.682014:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:8404:x1875571085694208:12345-0@lo:253: 20000000:01000000:3.0:1788684077.682037:0:6489:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788684077.682048:0:6489:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788684077.695497:0:6489:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788684077.695511:0:6489:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788684077.695680:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788684077.695685:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788684077.695705:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.695724:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740030800/0x44bac02bd54abff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abfef expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.695732:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac019 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.695739:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.695775:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac019 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.695788:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac019 expref: 16 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.695802:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085694336:0@lo:104: 00000100:00100000:2.0:1788684077.695873:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684077.695922:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740030800/0x44bac02bd54abff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abfef expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.695931:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740030800/0x44bac02bd54abff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abfef expref: 16 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.695939:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085694464:0@lo:104: 00000100:00100000:2.0:1788684077.695957:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684077.696036:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788684077.696053:0:6480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684077.696072:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085694336 00000100:00100000:1.0:1788684077.696078:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085694336 00000100:00100000:1.0:1788684077.696107:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085694464 00000100:00100000:1.0:1788684077.696109:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085694464 00000100:00100000:1.0:1788684077.696120:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788684077.696128:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6513:x1875571085694336:12345-0@lo:104: 00010000:00010000:1.0:1788684077.696140:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696191:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788684077.696197:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677e13d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6513:x1875571085694336:12345-0@lo:104: Request processed in 70us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684077.696204:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788684077.696236:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684077.696248:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6513:x1875571085694464:12345-0@lo:104: 00010000:00010000:1.0:1788684077.696256:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a6200/0x44bac02bd54abfef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696285:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788684077.696290:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6513:x1875571085694464:12345-0@lo:104: Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684077.696296:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788684077.696312:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684077.696318:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696325:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030c00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684077.696330:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696338:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684077.696346:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684077.696383:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684077.696536:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696544:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684077.696567:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696584:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac020 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696598:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684077.696601:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a6200/0x44bac02bd54abfef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696605:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a6200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684077.696608:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6200/0x44bac02bd54abfef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696614:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a6200/0x44bac02bd54abfef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684077.696620:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6200/0x44bac02bd54abfef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684077.696624:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684077.696639:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a6200/0x44bac02bd54abfef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696645:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684077.696657:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6200/0x44bac02bd54abfef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696663:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a6200/0x44bac02bd54abfef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54abff6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.696675:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684077.696682:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684077.696684:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684077.696736:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684077.696749:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085694592:0@lo:103: 00000100:00100000:2.0:1788684077.696781:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684077.696811:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085694592 00000100:00100000:2.0:1788684077.696815:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085694592 00010000:00010000:2.0:1788684077.696832:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac019 expref: 17 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.696860:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788684077.696867:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:3625:x1875571085694592:12345-0@lo:103: 00010000:00010000:2.0:1788684077.696876:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684077.696881:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac019 expref: 17 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.696890:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac019 expref: 17 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684077.696903:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684077.696930:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:3625:x1875571085694592:12345-0@lo:103: Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684077.696936:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788684077.696975:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085694592:0@lo:103: 00010000:00010000:2.0:1788684077.697001:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a6e00/0x44bac02bd54ac020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac019 expref: 16 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.697012:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085694336:0@lo:104: 00000100:00100000:2.0:1788684077.697019:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085694464:0@lo:104: 00010000:00010000:2.0:1788684077.697032:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684077.697086:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8404:x1875571085694208:12345-0@lo:253: Request processed in 15072us (15177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684077.697095:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788684077.697132:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8404:1875571085694208:0@lo:253: 10000000:01000000:2.0:1788684077.697141:0:8404:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788684077.697144:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788684077.697146:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788684077.697148:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788684077.697150:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788684077.697151:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788684077.697153:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788684077.697154:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788684077.697156:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788684077.697157:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788684077.697159:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788684077.697160:0:8404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788684077.697170:0:8404:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788684077.697503:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684077.699554:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085694720:0@lo:103: 00000100:00100000:0.0:1788684077.699618:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684077.699723:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085694720 00000100:00100000:1.0:1788684077.699730:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085694720 00010000:00010000:1.0:1788684077.699761:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740030800/0x44bac02bd54abff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abfef expref: 15 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684077.699795:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684077.699803:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3623:x1875571085694720:12345-0@lo:103: 00010000:00010000:1.0:1788684077.699815:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684077.699821:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740030800/0x44bac02bd54abff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abfef expref: 15 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699833:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740030800/0x44bac02bd54abff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abfef expref: 15 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699850:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030800/0x44bac02bd54abff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abfef expref: 15 pid: 6490 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699865:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699873:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788684077.699887:0:6483:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004202733s 00010000:00010000:1.0:1788684077.699892:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699899:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699923:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699930:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699935:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a6800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684077.699939:0:6483:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699948:0:6483:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699969:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684077.699980:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684077.700014:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:3623:x1875571085694720:12345-0@lo:103: Request processed in 212us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684077.700021:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684077.700083:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085694720:0@lo:103: 00010000:00010000:1.0:1788684077.700235:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684077.701795:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684077.701810:0:6513:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684077.701818:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac0f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788684077.717503:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788684077.717667:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788684077.717834:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788684077.718017:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788684077.718203:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788684077.720662:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788684077.728239:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788684077.745546:0:8404:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788684077.745555:0:8404:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788684077.745589:0:8404:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788684077.745629:0:8404:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788684077.745649:0:8404:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788684077.745677:0:8404:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788684077.746550:0:8404:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684077.746885:0:8404:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:1.0:1788684078.534187:0:8488:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788684078.534802:0:8488:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684078.717508:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684079.742172:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684080.767058:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085694848:0@lo:41: 00000100:00100000:3.0:1788684080.767125:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684080.768428:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684080.769387:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085694848 00000100:00100000:2.0:1788684080.769397:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085694848 00000100:00100000:2.0:1788684080.769440:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684080.769449:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085694848:12345-0@lo:41: 00000004:00000024:2.0:1788684080.769493:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788684080.769603:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085694848:12345-0@lo:41: Request processed in 154us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684080.769609:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684080.769654:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085694848:0@lo:41: 00000100:00100000:1.0:1788684081.279938:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684081.279960:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085694976:0@lo:41: 00000100:00100000:1.0:1788684081.280024:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684081.280150:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085694976 00000100:00100000:3.0:1788684081.280159:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085694976 00000100:00100000:3.0:1788684081.280209:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788684081.280218:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085694976:12345-0@lo:41: 00000004:00000024:3.0:1788684081.280247:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788684081.280299:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085694976:12345-0@lo:41: Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684081.280306:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788684081.281088:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085694976:0@lo:41: 00010000:00010000:1.0:1788684081.790527:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684082.813641:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085695104:0@lo:400: 00000100:00100000:1.0:1788684082.813711:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684082.813753:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085695616:0@lo:400: 00000100:00100000:1.0:1788684082.813779:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684082.813804:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684082.813809:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085695488:0@lo:400: 00000100:00100000:1.0:1788684082.813833:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684082.813862:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085695232:0@lo:400: 00000100:00100000:1.0:1788684082.813884:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684082.813902:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085695744:0@lo:400: 00000100:00100000:1.0:1788684082.813926:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684082.813944:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788684082.813949:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085695360:0@lo:400: 00000100:00100000:1.0:1788684082.813970:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684082.813986:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085695872:0@lo:400: 00000100:00100000:1.0:1788684082.814006:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684082.814034:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085695616 00000100:00100000:1.0:1788684082.814041:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085695616 00000100:00100000:1.0:1788684082.814074:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085695360 00000100:00100000:1.0:1788684082.814077:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085695360 00000100:00100000:1.0:1788684082.814090:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788684082.814097:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085695616:12345-0@lo:400: 00000100:00100000:1.0:1788684082.814147:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085695616:12345-0@lo:400: Request processed in 50us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684082.814155:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788684082.814177:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788684082.814183:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085695360:12345-0@lo:400: 00000100:00100000:1.0:1788684082.814214:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085695360:12345-0@lo:400: Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684082.814220:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788684082.814235:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085695488 00000100:00100000:1.0:1788684082.814238:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085695488 00000100:00100000:1.0:1788684082.814253:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085695232 00000100:00100000:1.0:1788684082.814255:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085695232 00000100:00100000:1.0:1788684082.814264:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085695744 00000100:00100000:1.0:1788684082.814266:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085695744 00000100:00100000:1.0:1788684082.814293:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085695872 00000100:00100000:1.0:1788684082.814296:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085695872 00000100:00100000:1.0:1788684082.814308:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788684082.814313:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085695488:12345-0@lo:400: 00000100:00100000:1.0:1788684082.814338:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085695488:12345-0@lo:400: Request processed in 25us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684082.814344:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788684082.814354:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788684082.814360:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085695232:12345-0@lo:400: 00000100:00100000:1.0:1788684082.814406:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085695232:12345-0@lo:400: Request processed in 45us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684082.814412:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788684082.814422:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788684082.814427:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085695744:12345-0@lo:400: 00000100:00100000:1.0:1788684082.814449:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085695744:12345-0@lo:400: Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684082.814454:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788684082.814483:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684082.814489:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085695872:12345-0@lo:400: 00000100:00100000:1.0:1788684082.814514:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085695872:12345-0@lo:400: Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684082.814519:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684082.814563:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085695360:0@lo:400: 00010000:00080000:1.0:1788684082.814575:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6646711880 x1875571085695872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684082.814584:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085695872:0@lo:400: 00010000:00080000:1.0:1788684082.814594:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6751bc3480 x1875571085695232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684082.814603:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085695232:0@lo:400: 00010000:00080000:1.0:1788684082.814611:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6646713b80 x1875571085695744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684082.814619:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085695744:0@lo:400: 00010000:00080000:1.0:1788684082.814662:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6751bc0380 x1875571085695488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684082.814670:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085695488:0@lo:400: 00000100:00100000:1.0:1788684082.814678:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085695616:0@lo:400: 00000100:00080000:0.0:1788684082.815002:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684082.815006:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684082.816454:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085695104 00000100:00100000:3.0:1788684082.816476:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085695104 00000100:00100000:3.0:1788684082.816521:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788684082.816530:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:3626:x1875571085695104:12345-0@lo:400: 00000100:00100000:3.0:1788684082.816601:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:3626:x1875571085695104:12345-0@lo:400: Request processed in 72us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684082.816608:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:3.0:1788684082.816669:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684082.816758:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085695104:0@lo:400: 00000001:02000400:0.0:1788684083.246791:0:8778:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788684083.838361:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788684084.245249:0:8830:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788684084.246943:0:8830:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788684084.862425:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788684084.862431:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d677cc6f800 from 30 10000000:01000000:0.0:1788684084.862436:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788684084.862486:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.862497:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.862508:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684084.862540:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696000:0@lo:101: 00000100:00100000:0.0:1788684084.862605:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684084.862650:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677ccd3300 going to sleep for 11 seconds 00010000:00010000:1.0:1788684084.863011:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684084.863084:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085696000 00000100:00100000:2.0:1788684084.863092:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085696000 00000100:00100000:2.0:1788684084.863138:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788684084.863147:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:6495:x1875571085696000:12345-0@lo:101: 00010000:00010000:2.0:1788684084.863159:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684084.863186:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac100 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.863206:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac100 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.863217:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac100 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.863225:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67560a6800, rc 0) 00000100:00100000:2.0:1788684084.863266:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085696000:12345-0@lo:101: Request processed in 120us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.863281:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788684084.863443:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696000:0@lo:101: 00010000:00010000:1.0:1788684084.863469:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.863479:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684084.863539:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646713b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696128:0@lo:501: 00000100:00100000:1.0:1788684084.863568:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.863591:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777145480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.863604:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085696128 00000100:00100000:1.0:1788684084.863608:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085696128 00000100:00100000:1.0:1788684084.863633:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788684084.863640:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085696128:12345-0@lo:501: 00000100:00100000:1.0:1788684084.863750:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085696128:12345-0@lo:501: Request processed in 111us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.863758:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788684084.863788:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646713b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696128:0@lo:501: 00000100:00100000:1.0:1788684084.863831:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646713b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696256:0@lo:503: 00000100:00100000:1.0:1788684084.863880:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.863893:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777145480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.863904:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085696256 00000100:00100000:1.0:1788684084.863907:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085696256 00000100:00100000:1.0:1788684084.863929:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788684084.863935:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085696256:12345-0@lo:503: 00000100:00100000:1.0:1788684084.864009:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085696256:12345-0@lo:503: Request processed in 74us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.864025:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788684084.864065:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646713b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696256:0@lo:503: 00000100:00100000:1.0:1788684084.864420:0:8872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646713b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8872:1875571085696384:0@lo:502: 00000100:00100000:1.0:1788684084.864463:0:8872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.864481:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085696384 00000100:00100000:1.0:1788684084.864485:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085696384 00000100:00100000:1.0:1788684084.864505:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788684084.864511:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8872:x1875571085696384:12345-0@lo:502: 00000100:00100000:1.0:1788684084.864582:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8872:x1875571085696384:12345-0@lo:502: Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.864589:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788684084.864616:0:8872:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.864628:0:8872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646713b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8872:1875571085696384:0@lo:502: 00000100:00100000:3.0:1788684084.866345:0:8872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8872:1875571085696512:0@lo:502: 00000100:00100000:3.0:1788684084.866427:0:8872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684084.866478:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085696512 00000100:00100000:3.0:1788684084.866483:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085696512 00000100:00100000:3.0:1788684084.866530:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788684084.866543:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8872:x1875571085696512:12345-0@lo:502: 00000100:00100000:3.0:1788684084.866652:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:8872:x1875571085696512:12345-0@lo:502: Request processed in 114us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.868926:0:8872:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677724d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684084.868964:0:8872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8872:1875571085696512:0@lo:502: 00000040:00080000:2.0:1788684084.869003:0:8872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788684084.869074:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788684084.869093:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788684084.869102:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.869117:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684084.869126:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788684084.869129:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d677cc6f800 from 5 10000000:01000000:2.0:1788684084.869131:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788684084.869285:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.869294:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.869303:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684084.869321:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696640:0@lo:101: 00000100:00100000:2.0:1788684084.869394:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684084.869423:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684084.869441:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085696640 00000100:00100000:2.0:1788684084.869457:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085696640 00000100:00100000:3.0:1788684084.874063:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788684084.882749:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788684084.882775:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085696640:12345-0@lo:101: 00010000:00010000:0.0:1788684084.882794:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684084.882813:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac10e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.882843:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac10e expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.882854:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac10e expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.882863:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740030c00, rc 0) 00000100:00100000:0.0:1788684084.882942:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085696640:12345-0@lo:101: Request processed in 180us (13547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684084.882949:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788684084.883200:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696640:0@lo:101: 00010000:00010000:2.0:1788684084.883218:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.883228:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684084.883284:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696768:0@lo:256: 00000100:00100000:2.0:1788684084.883320:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684084.883360:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684084.883720:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085696768 00000100:00100000:0.0:1788684084.883727:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085696768 00000100:00100000:0.0:1788684084.883769:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788684084.883777:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085696768:12345-0@lo:256: 20000000:01000000:0.0:1788684084.883791:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788684084.883809:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788684084.883813:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788684084.883914:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085696768:12345-0@lo:256: Request processed in 137us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684084.883928:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788684084.884674:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696768:0@lo:256: 10000000:01000000:2.0:1788684084.884725:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788684084.884734:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.884745:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684084.884754:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788684084.884756:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1788684084.884759:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788684084.884784:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.884792:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.884801:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684084.885134:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696896:0@lo:101: 00000100:00100000:3.0:1788684084.885855:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684084.885898:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684084.886179:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085696896 00000100:00100000:0.0:1788684084.886186:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085696896 00000100:00100000:0.0:1788684084.886311:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788684084.886321:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085696896:12345-0@lo:101: 00010000:00010000:0.0:1788684084.886335:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684084.886348:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac11c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.886718:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac11c expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.886732:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac11c expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.886742:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740030800, rc 0) 00000100:00100000:0.0:1788684084.886795:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085696896:12345-0@lo:101: Request processed in 476us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684084.886803:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788684084.886825:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085696896:0@lo:101: 00010000:00010000:3.0:1788684084.886842:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684084.886853:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684084.886923:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085697024:0@lo:501: 00000100:00100000:3.0:1788684084.886956:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684084.886985:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677724d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.887026:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085697024 00000100:00100000:1.0:1788684084.887030:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085697024 00000100:00100000:1.0:1788684084.887063:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788684084.887072:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085697024:12345-0@lo:501: 00000100:00100000:1.0:1788684084.888390:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085697024:12345-0@lo:501: Request processed in 1293us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.888400:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788684084.888525:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085697024:0@lo:501: 00000100:00100000:3.0:1788684084.888565:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085697152:0@lo:503: 00000100:00100000:3.0:1788684084.888612:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684084.888650:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677724d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684084.888768:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085697152 00000100:00100000:2.0:1788684084.888774:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085697152 00000100:00100000:2.0:1788684084.888815:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788684084.888823:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085697152:12345-0@lo:503: 00000100:00100000:2.0:1788684084.888916:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085697152:12345-0@lo:503: Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.888922:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788684084.895420:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085697152:0@lo:503: 00000100:00100000:3.0:1788684084.899322:0:8878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8878:1875571085697280:0@lo:502: 00000100:00100000:3.0:1788684084.899432:0:8878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684084.899486:0:8878:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677724d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.899628:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085697280 00000100:00100000:1.0:1788684084.899635:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085697280 00000100:00100000:1.0:1788684084.899756:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788684084.899766:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:8878:x1875571085697280:12345-0@lo:502: 00000100:00100000:1.0:1788684084.899888:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:8878:x1875571085697280:12345-0@lo:502: Request processed in 123us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.899901:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788684084.899976:0:8878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8878:1875571085697280:0@lo:502: 00000020:01000000:3.0:1788684084.900001:0:8878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788684084.900008:0:8878:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788684084.900014:0:8878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684084.900016:0:8878:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788684084.900021:0:8878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788684084.900029:0:8878:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:3.0:1788684084.900049:0:8878:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788684084.900053:0:8878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684084.900073:0:8878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d677721b380) 00000020:00000080:3.0:1788684084.900094:0:8878:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788684084.900100:0:8878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788684084.900264:0:8878:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788684084.900270:0:8878:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788684084.900277:0:8878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ac131 00010000:00080000:3.0:1788684084.900302:0:8878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677fa0e000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684084.900563:0:8878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788684084.910634:0:8878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788684084.910656:0:8878:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788684084.910941:0:8878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684084.911147:0:8878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684084.911231:0:8878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788684084.911340:0:8878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788684084.911723:0:8880:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684084.911727:0:8880:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788684084.912536:0:8878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788684084.912550:0:8878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788684084.912587:0:8878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788684084.912607:0:8878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ac138 00000100:00080000:3.0:1788684084.912616:0:8878:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684084.912622:0:8878:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d677fa0e000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684084.912655:0:8878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6751b56680 x1875571085697408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684084.912707:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085697408:0@lo:8: 00000100:00100000:1.0:1788684084.912771:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788684084.912840:0:8878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788684084.912890:0:8878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684084.912895:0:8878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684084.912896:0:8878:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788684084.912900:0:8878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684084.912903:0:8878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684084.912905:0:8878:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684084.912907:0:8878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684084.912909:0:8878:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788684084.912933:0:8878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8878:1875571085697536:0@lo:502: 00000100:00100000:3.0:1788684084.912978:0:8878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684084.913012:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085697536 00000100:00100000:3.0:1788684084.913018:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085697536 00000100:00100000:3.0:1788684084.913060:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788684084.913070:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:8878:x1875571085697536:12345-0@lo:502: 00000100:00100000:3.0:1788684084.913174:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:8878:x1875571085697536:12345-0@lo:502: Request processed in 105us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684084.913182:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788684084.913218:0:8878:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788684084.913239:0:8878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8878:1875571085697536:0@lo:502: 00000020:01000000:3.0:1788684084.913262:0:8878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684084.913266:0:8878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684084.913267:0:8878:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788684084.913270:0:8878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1788684084.913694:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085697408 00000100:00100000:1.0:1788684084.913699:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085697408 00000100:00100000:1.0:1788684084.913728:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684084.913733:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1875571085697408:12345-0@lo:8: 00010000:00080000:1.0:1788684084.913754:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:1.0:1788684084.913779:0:8411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ac13f 00002000:00100000:1.0:1788684084.913811:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d677f9b3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788684084.913815:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788684084.913818:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788684084.914048:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788684084.914274:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788684084.914297:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8d677f9b4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684084.917988:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1875571085697408:12345-0@lo:8: Request processed in 4245us (5208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.918000:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684084.918127:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085697792:0@lo:400: 00000100:00100000:1.0:1788684084.918162:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.918185:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085698304:0@lo:400: 00000100:00100000:1.0:1788684084.918207:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.918225:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788684084.918230:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085697664:0@lo:400: 00000100:00100000:1.0:1788684084.918248:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.918278:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085698176:0@lo:400: 00000100:00100000:1.0:1788684084.918297:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.918334:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085697920:0@lo:400: 00000100:00100000:1.0:1788684084.918355:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.918397:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684084.918402:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085698048:0@lo:400: 00000100:00100000:1.0:1788684084.918427:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.918469:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085697792 00000100:00100000:1.0:1788684084.918475:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085697792 00000100:00100000:1.0:1788684084.918504:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085698048 00000100:00100000:1.0:1788684084.918507:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085698048 00000100:00100000:1.0:1788684084.918521:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788684084.918528:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085697792:12345-0@lo:400: 00000100:00100000:1.0:1788684084.918572:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085697792:12345-0@lo:400: Request processed in 44us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.918578:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788684084.918591:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684084.918597:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085698048:12345-0@lo:400: 00000100:00100000:1.0:1788684084.918627:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085698048:12345-0@lo:400: Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.918632:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684084.918647:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085698304 00000100:00100000:1.0:1788684084.918651:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085698304 00000100:00100000:1.0:1788684084.918677:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085697664 00000100:00100000:1.0:1788684084.918680:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085697664 00000100:00100000:1.0:1788684084.918689:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085698176 00000100:00100000:1.0:1788684084.918692:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085698176 00000100:00100000:1.0:1788684084.918703:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085697920 00000100:00100000:1.0:1788684084.918705:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085697920 00000100:00100000:1.0:1788684084.918727:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684084.918733:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085698304:12345-0@lo:400: 00000100:00100000:1.0:1788684084.918765:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085698304:12345-0@lo:400: Request processed in 32us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.918771:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684084.918783:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684084.918789:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085697664:12345-0@lo:400: 00000100:00100000:1.0:1788684084.918815:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085697664:12345-0@lo:400: Request processed in 26us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.918821:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684084.919985:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788684084.919995:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085698176:12345-0@lo:400: 00000100:00100000:1.0:1788684084.920043:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085698176:12345-0@lo:400: Request processed in 50us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.920049:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788684084.920060:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788684084.920065:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085697920:12345-0@lo:400: 00000100:00100000:1.0:1788684084.920088:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085697920:12345-0@lo:400: Request processed in 24us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.920093:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788684084.920122:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684084.920126:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788684084.920155:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085698048:0@lo:400: 00010000:00080000:1.0:1788684084.920168:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6646713480 x1875571085697920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684084.920178:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085697920:0@lo:400: 00010000:00080000:1.0:1788684084.920235:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6646711880 x1875571085697664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684084.920244:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085697664:0@lo:400: 00010000:00080000:1.0:1788684084.920253:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6646712a00 x1875571085698176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684084.920261:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085698176:0@lo:400: 00000100:00100000:1.0:1788684084.920272:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085697792:0@lo:400: 00010000:00080000:1.0:1788684084.920281:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6646710380 x1875571085698304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684084.920289:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085698304:0@lo:400: 00000020:01000000:1.0:1788684084.920333:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788684084.920360:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788684084.920384:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.920394:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684084.920403:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788684084.920405:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67466b4800 from 30 10000000:01000000:1.0:1788684084.920408:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788684084.920434:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.920441:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.920473:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684084.920491:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085698432:0@lo:101: 00000100:00100000:1.0:1788684084.920524:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.920553:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684084.920976:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085698432 00000100:00100000:2.0:1788684084.920983:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085698432 00000100:00100000:2.0:1788684084.921027:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788684084.921035:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085698432:12345-0@lo:101: 00010000:00010000:2.0:1788684084.921045:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684084.921056:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac146 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.921076:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac146 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.921086:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac146 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.921095:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67560a7400, rc 0) 00000100:00100000:2.0:1788684084.921144:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085698432:12345-0@lo:101: Request processed in 110us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.921151:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788684084.922036:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085698432:0@lo:101: 00010000:00010000:2.0:1788684084.922061:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684084.922072:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684084.922144:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085698560:0@lo:501: 00000100:00100000:2.0:1788684084.922261:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684084.922296:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684084.922310:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085698560 00000100:00100000:2.0:1788684084.922315:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085698560 00000100:00100000:2.0:1788684084.922340:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788684084.922347:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085698560:12345-0@lo:501: 00000100:00100000:2.0:1788684084.922473:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085698560:12345-0@lo:501: Request processed in 126us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.922480:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788684084.922511:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085698560:0@lo:501: 00000100:00100000:2.0:1788684084.922536:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085698688:0@lo:503: 00000100:00100000:2.0:1788684084.922580:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684084.922596:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684084.922608:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085698688 00000100:00100000:2.0:1788684084.922611:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085698688 00000100:00100000:2.0:1788684084.922635:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788684084.922644:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085698688:12345-0@lo:503: 00010000:00080000:0.0:1788684084.922726:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6751b56680 x1875571085697408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684084.922741:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684084.922748:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788684084.922755:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788684084.922761:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788684084.922764:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677fa0e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788684084.922777:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788684084.922782:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085697408:0@lo:8: 00000004:00080000:0.0:1788684084.922805:0:8880:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788684084.923254:0:8880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 165916886386ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788684084.923260:0:8880:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788684084.923300:0:8881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8881:1875571085698816:0@lo:700: 00000100:00100000:2.0:1788684084.924868:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085698688:12345-0@lo:503: Request processed in 2221us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.924878:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788684084.925020:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085698688:0@lo:503: 00000004:00080000:1.0:1788684084.925742:0:7428:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788684084.925934:0:8881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684084.925966:0:8881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.926021:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085698816 00000100:00100000:1.0:1788684084.926028:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085698816 00000100:00100000:1.0:1788684084.926116:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684084.926126:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8881:x1875571085698816:12345-0@lo:700: 00000100:00100000:1.0:1788684084.926175:0:8419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8419:1875571085698944:0@lo:700: 00000100:00100000:1.0:1788684084.926208:0:8419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.926225:0:8419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f3c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788684084.926259:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684084.926693:0:8884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8884:1875571085699072:0@lo:502: 00000100:00100000:1.0:1788684084.926736:0:8884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.926810:0:8884:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788684084.926825:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085698944 00000100:00100000:3.0:1788684084.926830:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085698944 00000100:00100000:3.0:1788684084.926873:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684084.926881:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8419:x1875571085698944:12345-0@lo:700: 00000100:00100000:0.0:1788684084.926948:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085699072 00000100:00100000:0.0:1788684084.926953:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085699072 00000100:00100000:0.0:1788684084.927001:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788684084.927078:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:8884:x1875571085699072:12345-0@lo:502: 00000100:00100000:0.0:1788684084.930236:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:8884:x1875571085699072:12345-0@lo:502: Request processed in 3153us (3491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684084.930251:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788684084.930561:0:8884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8884:1875571085699072:0@lo:502: 00000100:00100000:1.0:1788684084.930640:0:8884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8884:1875571085699200:0@lo:502: 00000100:00100000:1.0:1788684084.930699:0:8884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684084.930726:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085699200 00000100:00100000:2.0:1788684084.930734:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085699200 00000100:00100000:1.0:1788684084.930736:0:8884:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684084.930771:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788684084.930779:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:8884:x1875571085699200:12345-0@lo:502: 00000100:00100000:2.0:1788684084.930898:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:8884:x1875571085699200:12345-0@lo:502: Request processed in 119us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.930905:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788684084.931021:0:8884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8884:1875571085699200:0@lo:502: 00000040:00080000:1.0:1788684084.931042:0:8884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788684084.931199:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788684084.931229:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788684084.931240:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.931262:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684084.931272:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684084.931275:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d67466b4800 from 5 10000000:01000000:0.0:1788684084.931278:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684084.931306:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.931325:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.931333:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684084.931349:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699328:0@lo:101: 00000100:00100000:0.0:1788684084.931416:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684084.931441:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788684084.931468:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085699328 00000100:00100000:0.0:1788684084.931472:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085699328 00000100:00100000:0.0:1788684084.931503:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788684084.931511:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085699328:12345-0@lo:101: 00010000:00010000:0.0:1788684084.931525:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684084.931537:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac154 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.931558:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac154 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.931586:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac154 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.931596:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740031c00, rc 0) 00000100:00100000:0.0:1788684084.931632:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085699328:12345-0@lo:101: Request processed in 123us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684084.931638:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788684084.931672:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699328:0@lo:101: 00010000:00010000:0.0:1788684084.931685:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.931692:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684084.931738:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699456:0@lo:256: 00000100:00100000:0.0:1788684084.931770:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684084.931791:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684084.931793:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085699456 00000100:00100000:2.0:1788684084.931799:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085699456 00000100:00100000:2.0:1788684084.931825:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788684084.931831:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085699456:12345-0@lo:256: 20000000:01000000:2.0:1788684084.931844:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788684084.931858:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788684084.931862:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788684084.931942:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085699456:12345-0@lo:256: Request processed in 110us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.931948:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788684084.931990:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699456:0@lo:256: 10000000:01000000:0.0:1788684084.932031:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684084.932036:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.932044:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684084.932051:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788684084.932058:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788684084.932060:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788684084.932076:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.932082:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.932089:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684084.932101:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699584:0@lo:101: 00000100:00100000:0.0:1788684084.932125:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684084.932181:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.932221:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085699584 00000100:00100000:1.0:1788684084.932226:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085699584 00000100:00100000:1.0:1788684084.932259:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788684084.932266:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085699584:12345-0@lo:101: 00010000:00010000:1.0:1788684084.932273:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684084.932281:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac162 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.932294:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac162 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.932302:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac162 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.932388:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d674148ac00, rc 0) 00000100:00100000:1.0:1788684084.932480:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085699584:12345-0@lo:101: Request processed in 215us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.932486:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788684084.932541:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699584:0@lo:101: 00010000:00010000:0.0:1788684084.932554:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684084.932562:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684084.932612:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699712:0@lo:501: 00000100:00100000:0.0:1788684084.932640:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684084.932666:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684084.932796:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085699712 00000100:00100000:2.0:1788684084.932801:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085699712 00000100:00100000:2.0:1788684084.932832:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788684084.932839:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085699712:12345-0@lo:501: 00000100:00100000:2.0:1788684084.932942:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085699712:12345-0@lo:501: Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.932948:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788684084.933032:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699712:0@lo:501: 00000100:00100000:0.0:1788684084.933075:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699840:0@lo:503: 00000100:00100000:0.0:1788684084.933113:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684084.933171:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.933437:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085699840 00000100:00100000:1.0:1788684084.933442:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085699840 00000100:00100000:1.0:1788684084.933529:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788684084.933537:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085699840:12345-0@lo:503: 00000100:00100000:1.0:1788684084.933625:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085699840:12345-0@lo:503: Request processed in 89us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.933632:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788684084.933712:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085699840:0@lo:503: 00000100:00100000:3.0:1788684084.936411:0:8886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8886:1875571085699968:0@lo:502: 00000100:00100000:3.0:1788684084.936489:0:8886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684084.936529:0:8886:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.936555:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085699968 00000100:00100000:1.0:1788684084.936562:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085699968 00000100:00100000:1.0:1788684084.936605:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788684084.936614:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:8886:x1875571085699968:12345-0@lo:502: 00000100:00100000:1.0:1788684084.936734:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:8886:x1875571085699968:12345-0@lo:502: Request processed in 121us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.936742:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788684084.937194:0:8886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8886:1875571085699968:0@lo:502: 00000020:01000000:3.0:1788684084.937223:0:8886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788684084.937230:0:8886:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788684084.937236:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684084.937238:0:8886:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788684084.937243:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788684084.937253:0:8886:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:3.0:1788684084.937276:0:8886:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788684084.937279:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684084.937291:0:8886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d67772199c0) 00000020:00000080:3.0:1788684084.937318:0:8886:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788684084.937324:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788684084.937481:0:8886:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788684084.937486:0:8886:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788684084.937493:0:8886:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ac177 00010000:00080000:3.0:1788684084.937533:0:8886:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677cefb000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684084.937757:0:8886:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:2.0:1788684084.939665:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000001:00100000:0.0:1788684084.944177:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788684084.946704:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8419:x1875571085698944:12345-0@lo:700: Request processed in 19816us (20487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684084.946716:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788684084.946868:0:8419:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6751bc0380 x1875571085698944/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788684100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684084.946881:0:8419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8419:1875571085698944:0@lo:700: 40000000:02000000:1.0:1788684084.946896:0:8419:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1788684084.966036:0:8886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788684084.966060:0:8886:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788684084.966460:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8881:x1875571085698816:12345-0@lo:700: Request processed in 40322us (40512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.966470:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788684084.966494:0:8881:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6780031f80 x1875571085698816/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788684100 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684084.966509:0:8881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8881:1875571085698816:0@lo:700: 00000040:00080000:0.0:1788684084.966739:0:8886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684084.966950:0:8886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684084.967275:0:8886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788684084.967471:0:8886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788684084.967996:0:8887:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684084.968001:0:8887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788684084.968808:0:8886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788684084.968819:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788684084.968854:0:8886:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788684084.968875:0:8886:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ac17e 00000100:00080000:1.0:1788684084.968884:0:8886:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788684084.968889:0:8886:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d677cefb000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684084.968921:0:8886:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6751bc0380 x1875571085700096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788684084.968938:0:8886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788684084.969052:0:8886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684084.969057:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684084.969059:0:8886:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788684084.969062:0:8886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684084.969066:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684084.969068:0:8886:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788684084.969071:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788684084.969073:0:8886:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788684084.969106:0:8886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8886:1875571085700224:0@lo:502: 00000100:00100000:1.0:1788684084.969180:0:8886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.969213:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085700224 00000100:00100000:1.0:1788684084.969219:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085700224 00000100:00100000:1.0:1788684084.969254:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788684084.969262:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:8886:x1875571085700224:12345-0@lo:502: 00000100:00100000:1.0:1788684084.969355:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:8886:x1875571085700224:12345-0@lo:502: Request processed in 93us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.969362:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788684084.969427:0:8886:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.969458:0:8886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:8886:1875571085700224:0@lo:502: 00000020:01000000:1.0:1788684084.969481:0:8886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684084.969485:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684084.969486:0:8886:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788684084.969489:0:8886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788684084.969546:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788684084.969565:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788684084.969574:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.969585:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684084.969595:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788684084.969597:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d67482e3380 from 1 10000000:01000000:1.0:1788684084.969600:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788684084.969624:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.969642:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.969652:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684084.969853:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085700352:0@lo:101: 00000100:00100000:1.0:1788684084.969883:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.969900:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67453983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.969913:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085700352 00000100:00100000:1.0:1788684084.969917:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085700352 00000100:00100000:1.0:1788684084.969940:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788684084.969947:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085700352:12345-0@lo:101: 00010000:00010000:1.0:1788684084.969956:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684084.969967:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac185 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.969986:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac185 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.969996:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac185 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.970004:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d674148a200, rc 0) 00000100:00100000:1.0:1788684084.970035:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085700352:12345-0@lo:101: Request processed in 88us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.970041:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788684084.970074:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085700352:0@lo:101: 00010000:00010000:1.0:1788684084.970094:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.970103:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684084.970145:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085700480:0@lo:501: 00000100:00100000:1.0:1788684084.970172:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.970195:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085700480 00000100:00100000:1.0:1788684084.970199:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085700480 00000100:00100000:1.0:1788684084.970226:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788684084.970233:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085700480:12345-0@lo:501: 00000100:00100000:1.0:1788684084.970296:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085700480:12345-0@lo:501: Request processed in 62us (122us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788684084.970304:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788684084.970329:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67453983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684084.970342:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085700480:0@lo:501: 10000000:01000000:1.0:1788684084.970362:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788684084.972079:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684084.972090:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684084.972333:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085700096:0@lo:8: 00000100:00100000:0.0:1788684084.972571:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684084.972659:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085700096 00000100:00100000:1.0:1788684084.972666:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085700096 00000100:00100000:1.0:1788684084.972707:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684084.972713:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1875571085700096:12345-0@lo:8: 00010000:00080000:1.0:1788684084.972748:0:8413:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:1.0:1788684084.972778:0:8413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ac193 00002000:00100000:1.0:1788684084.972791:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d6645994800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788684084.972794:0:8413:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788684084.972797:0:8413:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788684084.972864:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788684084.972889:0:8413:0:(import.c:65:import_set_state_nolock()) ffff8d6645997000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684084.972946:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875571085700096:12345-0@lo:8: Request processed in 232us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.972954:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788684084.981335:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6751bc0380 x1875571085700096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684084.981359:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684084.981395:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788684084.981405:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788684084.981411:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788684084.981414:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cefb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788684084.981437:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788684084.981453:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085700096:0@lo:8: 00000004:00080000:0.0:1788684084.981485:0:8887:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788684084.981531:0:8887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 165975164700ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788684084.981537:0:8887:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788684084.990963:0:8881:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788684084.990993:0:8881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8881:1875571085700736:0@lo:7: 00000100:00100000:2.0:1788684084.991051:0:8881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684084.991083:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684084.991087:0:8881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684084.991096:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085700608:0@lo:13: 00000100:00100000:2.0:1788684084.991108:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085700736 00000100:00100000:2.0:1788684084.991115:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085700736 00000100:00100000:0.0:1788684084.991126:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684084.991158:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684084.991167:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8881:x1875571085700736:12345-0@lo:7: 00000004:00080000:3.0:1788684084.997664:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788684084.999757:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085700608 00000100:00100000:1.0:1788684084.999770:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085700608 00000100:00100000:1.0:1788684084.999813:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684084.999821:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1875571085700608:12345-0@lo:13: 00002000:00000024:1.0:1788684084.999848:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:1.0:1788684084.999921:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1875571085700608:12345-0@lo:13: Request processed in 100us (8793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684084.999928:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1788684084.999982:0:8888:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788684085.000001:0:8888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1875571085700992:0@lo:7: 00000100:00100000:0.0:1788684085.000233:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684085.000245:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085700864:0@lo:13: 00002000:00080000:2.0:1788684085.000269:0:8411:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788684085.000275:0:8411:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788684085.000317:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8881:x1875571085700736:12345-0@lo:7: Request processed in 9152us (9266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684085.000320:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684085.000325:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788684085.000362:0:8881:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66459bfb80 x1875571085700736/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788684100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684085.000401:0:8881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8881:1875571085700736:0@lo:7: 00000004:00080000:2.0:1788684085.000412:0:8881:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788684085.000435:0:8881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8881:1875571085701120:0@lo:5: 00000100:00100000:2.0:1788684085.000470:0:8881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684085.000498:0:8881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684085.000511:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085701120 00000100:00100000:2.0:1788684085.000515:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085701120 00000100:00100000:2.0:1788684085.000537:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684085.000543:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8881:x1875571085701120:12345-0@lo:5: 00002000:00080000:2.0:1788684085.000566:0:8413:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788684085.000596:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8881:x1875571085701120:12345-0@lo:5: Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684085.000602:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788684085.000627:0:8881:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66459bfb80 x1875571085701120/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684085.000637:0:8881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8881:1875571085701120:0@lo:5: 00000004:00080000:2.0:1788684085.000644:0:8881:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788684085.000682:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085700864 00000100:00100000:0.0:1788684085.000687:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085700864 00000100:00100000:0.0:1788684085.000731:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788684085.000738:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085700864:12345-0@lo:13: 00002000:00000024:0.0:1788684085.000748:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:0.0:1788684085.000780:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085700864:12345-0@lo:13: Request processed in 43us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684085.000785:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788684085.000810:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66459bdc00 x1875571085700608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684085.000824:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085700608:0@lo:13: 00010000:00080000:0.0:1788684085.000843:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6751bc2680 x1875571085700864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684085.000852:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085700864:0@lo:13: 00000100:00080000:2.0:1788684085.003287:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684085.003469:0:8888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684085.003498:0:8888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684085.003788:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085700992 00000100:00100000:2.0:1788684085.003796:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085700992 00000100:00100000:2.0:1788684085.003847:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788684085.003855:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8888:x1875571085700992:12345-0@lo:7: 00002000:00080000:0.0:1788684085.013562:0:8413:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788684085.013570:0:8413:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788684085.013657:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8888:x1875571085700992:12345-0@lo:7: Request processed in 9799us (10186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684085.013671:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788684085.013995:0:8888:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6751bc0380 x1875571085700992/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788684101 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684085.014009:0:8888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1875571085700992:0@lo:7: 00000004:00080000:1.0:1788684085.014023:0:8888:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788684085.014069:0:8888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1875571085701248:0@lo:5: 00000100:00100000:1.0:1788684085.014104:0:8888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684085.014135:0:8888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684085.015867:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085701248 00000100:00100000:2.0:1788684085.015883:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085701248 00000100:00100000:2.0:1788684085.015951:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684085.015963:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8888:x1875571085701248:12345-0@lo:5: 00002000:00080000:2.0:1788684085.015999:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788684085.016003:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788684085.028264:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788684085.028282:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788684085.028595:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8888:x1875571085701248:12345-0@lo:5: Request processed in 12631us (14485us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788684085.028605:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788684085.028706:0:8888:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6751bc0380 x1875571085701248/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684101 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684085.028718:0:8888:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788684085.028724:0:8888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1875571085701248:0@lo:5: 00000004:00080000:1.0:1788684085.028739:0:8888:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788684085.028784:0:8888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1875571085701376:0@lo:700: 00000100:00100000:1.0:1788684085.028821:0:8888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684085.028884:0:8888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684085.028948:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085701376 00000100:00100000:2.0:1788684085.028955:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085701376 00000100:00100000:2.0:1788684085.028993:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684085.029001:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8888:x1875571085701376:12345-0@lo:700: 00000100:00100000:2.0:1788684085.039905:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8888:x1875571085701376:12345-0@lo:700: Request processed in 10895us (11074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684085.039927:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788684085.040055:0:8888:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6751bc0380 x1875571085701376/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788684101 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684085.040072:0:8888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1875571085701376:0@lo:700: 00000004:02000040:1.0:1788684085.042125:0:8888:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788684085.062810:0:8888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1875571085701504:0@lo:5: 00000100:00100000:0.0:1788684085.062874:0:8888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684085.062942:0:8888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684085.063171:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085701504 00000100:00100000:2.0:1788684085.063179:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085701504 00000100:00100000:2.0:1788684085.063233:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684085.063243:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8888:x1875571085701504:12345-0@lo:5: 00002000:00080000:2.0:1788684085.071134:0:8413:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788684085.071156:0:8413:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1788684085.073812:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8888:x1875571085701504:12345-0@lo:5: Request processed in 10565us (10931us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788684085.073824:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788684085.073950:0:8888:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6780031f80 x1875571085701504/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684101 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684085.073967:0:8888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1875571085701504:0@lo:5: 00000004:00080000:0.0:1788684085.073993:0:8888:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:1.0:1788684085.885578:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788684085.885715:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684085.887292:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085701632:0@lo:41: 00000100:00100000:1.0:1788684085.887521:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684085.890946:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085701632 00000100:00100000:2.0:1788684085.890961:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085701632 00000100:00100000:2.0:1788684085.891095:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788684085.891106:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085701632:12345-0@lo:41: 00000004:00000024:2.0:1788684085.891142:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788684085.891243:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085701632:12345-0@lo:41: Request processed in 139us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684085.891250:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684085.891350:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085701632:0@lo:41: 00000001:00080000:3.0:1788684086.008525:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1788684086.402993:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684086.403020:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085701760:0@lo:41: 00000100:00100000:2.0:1788684086.403099:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684086.403174:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085701760 00000100:00100000:2.0:1788684086.403181:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085701760 00000100:00100000:2.0:1788684086.403220:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788684086.403227:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085701760:12345-0@lo:41: 00000004:00000024:2.0:1788684086.403258:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788684086.403297:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085701760:12345-0@lo:41: Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684086.403311:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788684086.403355:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085701760:0@lo:41: 00000020:00000004:2.0:1788684086.731102:0:8939:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684086.731307:0:8939:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684086.914337:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788684087.482109:0:8988:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684087.482119:0:8988:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788684087.933506:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684088.958678:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684089.983357:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684089.983444:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085701888:0@lo:400: 00000100:00100000:0.0:1788684089.983492:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085702016:0@lo:400: 00000100:00100000:1.0:1788684089.983576:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684089.983592:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684089.983673:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085702528:0@lo:400: 00000100:00100000:3.0:1788684089.984004:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085701888 00000100:00100000:3.0:1788684089.984015:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085701888 00000100:00100000:1.0:1788684089.984050:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085702400:0@lo:400: 00000100:00100000:3.0:1788684089.984080:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788684089.984087:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684089.984091:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3623:x1875571085701888:12345-0@lo:400: 00000100:00100000:1.0:1788684089.984110:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085702912:0@lo:400: 00000100:00100000:1.0:1788684089.984143:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684089.984148:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3623:x1875571085701888:12345-0@lo:400: Request processed in 60us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684089.984156:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788684089.984177:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085701888:0@lo:400: 00000100:00100000:1.0:1788684089.984354:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085702400 00000100:00100000:1.0:1788684089.984360:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085702400 00000100:00100000:1.0:1788684089.984438:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788684089.984448:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085702400:12345-0@lo:400: 00000100:00100000:1.0:1788684089.984571:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085702400:12345-0@lo:400: Request processed in 124us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684089.984580:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788684089.984679:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085702016 00000100:00100000:1.0:1788684089.984680:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085702912 00000100:00100000:2.0:1788684089.984686:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085702016 00000100:00100000:1.0:1788684089.984688:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085702912 00000100:00100000:1.0:1788684089.984808:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684089.984816:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085702912:12345-0@lo:400: 00000100:00100000:1.0:1788684089.984934:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085702912:12345-0@lo:400: Request processed in 118us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684089.984942:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788684089.984962:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684089.985051:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085702400:0@lo:400: 00010000:00080000:1.0:1788684089.985067:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6775ef7480 x1875571085702912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684089.985077:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788684089.985092:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085702912:0@lo:400: 00000100:00100000:2.0:1788684089.985156:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788684089.985167:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085702016:12345-0@lo:400: 00000100:00100000:2.0:1788684089.985220:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085702016:12345-0@lo:400: Request processed in 57us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684089.985227:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788684089.985256:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085702272:0@lo:400: 00000100:00100000:2.0:1788684089.985297:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085702144:0@lo:400: 00000100:00100000:2.0:1788684089.985327:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684089.985348:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085702656:0@lo:400: 00000100:00100000:1.0:1788684089.985606:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085702144 00000100:00100000:1.0:1788684089.985612:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085702144 00000100:00100000:1.0:1788684089.985647:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684089.985664:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085702144:12345-0@lo:400: 00000100:00100000:0.0:1788684089.985915:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684089.986015:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085702144:12345-0@lo:400: Request processed in 360us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684089.986023:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788684089.986039:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6780032300 x1875571085702016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684089.986051:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085702016:0@lo:400: 00000100:00100000:0.0:1788684089.986085:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085702528 00000100:00100000:0.0:1788684089.986089:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085702528 00000100:00080000:1.0:1788684089.986203:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684089.986303:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788684089.986313:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085702528:12345-0@lo:400: 00000100:00100000:0.0:1788684089.986387:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085702528:12345-0@lo:400: Request processed in 77us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684089.986396:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788684089.986480:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6775ef4a80 x1875571085702528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684089.986491:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085702528:0@lo:400: 00000100:00100000:2.0:1788684089.986617:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684089.986696:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085702144:0@lo:400: 00000100:00100000:0.0:1788684089.986880:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085702656 00000100:00100000:0.0:1788684089.986886:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085702656 00000100:00100000:0.0:1788684089.986930:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788684089.986937:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085702656:12345-0@lo:400: 00000100:00100000:0.0:1788684089.986982:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085702656:12345-0@lo:400: Request processed in 45us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684089.986989:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788684089.987014:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684089.987043:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085702784:0@lo:400: 00000100:00100000:0.0:1788684089.987082:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684089.987124:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085702272 00000100:00100000:0.0:1788684089.987128:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085702272 00000100:00100000:0.0:1788684089.987153:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788684089.987159:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085702272:12345-0@lo:400: 00000100:00100000:0.0:1788684089.987212:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085702272:12345-0@lo:400: Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684089.987218:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788684089.987244:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6775ef5500 x1875571085702272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684089.987255:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085702272:0@lo:400: 00010000:00080000:0.0:1788684089.987278:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6775ef5c00 x1875571085702656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684089.987287:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085702656:0@lo:400: 00000100:00100000:2.0:1788684089.987431:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085702784 00000100:00100000:2.0:1788684089.987436:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085702784 00000100:00100000:2.0:1788684089.987472:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684089.987480:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085702784:12345-0@lo:400: 00000100:00100000:2.0:1788684089.987522:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085702784:12345-0@lo:400: Request processed in 44us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684089.987528:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788684089.987553:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684089.987558:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788684089.987643:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6775ef5f80 x1875571085702784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684089.987653:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085702784:0@lo:400: 00000100:00100000:1.0:1788684090.494655:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684090.494684:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085703040:0@lo:13: 00000100:00100000:1.0:1788684090.494771:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684090.494846:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085703040 00000100:00100000:1.0:1788684090.494854:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085703040 00000100:00100000:1.0:1788684090.494915:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684090.494926:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085703040:12345-0@lo:13: 00002000:00000024:1.0:1788684090.494965:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684090.495022:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085703040:12345-0@lo:13: Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684090.495030:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788684090.495073:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6646713480 x1875571085703040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684090.495093:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085703040:0@lo:13: 00000100:00100000:2.0:1788684090.495598:0:8881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8881:1875571085703296:0@lo:5: 00000100:00100000:2.0:1788684090.495641:0:8881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684090.495673:0:8881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743344780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684090.495691:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085703296 00000100:00100000:2.0:1788684090.495695:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085703296 00000100:00100000:2.0:1788684090.495731:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684090.495739:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8881:x1875571085703296:12345-0@lo:5: 00002000:00080000:2.0:1788684090.495775:0:8412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788684090.497755:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8881:x1875571085703296:12345-0@lo:5: Request processed in 2010us (2106us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788684090.497769:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788684090.497846:0:8881:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66459bd500 x1875571085703296/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684106 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684090.497866:0:8881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8881:1875571085703296:0@lo:5: 00000004:00080000:2.0:1788684090.497885:0:8881:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788684090.497931:0:8881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8881:1875571085703424:0@lo:900: 00000100:00100000:2.0:1788684090.497970:0:8881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684090.497993:0:8881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742f85600 going to sleep for 11 seconds 00000100:00100000:3.0:1788684090.498447:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684090.498463:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085703168:0@lo:13: 00000100:00100000:3.0:1788684090.498520:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684090.498587:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085703424 00000100:00100000:3.0:1788684090.498595:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085703424 00000100:00100000:3.0:1788684090.498640:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684090.498650:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8881:x1875571085703424:12345-0@lo:900: 00000100:00100000:3.0:1788684090.498705:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8881:x1875571085703424:12345-0@lo:900: Request processed in 56us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684090.498712:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684090.498761:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085703168 00000100:00100000:3.0:1788684090.498765:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085703168 00000100:00100000:3.0:1788684090.498791:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788684090.498800:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1875571085703168:12345-0@lo:13: 00002000:00000024:3.0:1788684090.498816:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684090.498857:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1875571085703168:12345-0@lo:13: Request processed in 59us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684090.498863:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788684090.498993:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66459be300 x1875571085703168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684090.499008:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085703168:0@lo:13: 00010000:00080000:3.0:1788684090.499040:0:8881:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66459bfb80 x1875571085703424/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788684106 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684090.499049:0:8881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8881:1875571085703424:0@lo:900: 00000100:00100000:3.0:1788684091.005622:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085703552:0@lo:41: 00000100:00100000:3.0:1788684091.005844:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684091.005901:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085703552 00010000:00010000:3.0:1788684091.005931:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684091.005982:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085703552 00000100:00100000:1.0:1788684091.006041:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684091.006048:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788684091.006055:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085703552:12345-0@lo:41: 00000100:00100000:0.0:1788684091.006062:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:1.0:1788684091.006110:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788684091.006186:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085703552:12345-0@lo:41: Request processed in 135us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684091.006263:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684091.006852:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085703552:0@lo:41: 00000100:00100000:0.0:1788684091.519144:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684091.519166:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085703680:0@lo:41: 00000100:00100000:0.0:1788684091.519235:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684091.519300:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085703680 00000100:00100000:0.0:1788684091.519308:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085703680 00000100:00100000:0.0:1788684091.519351:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684091.519359:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085703680:12345-0@lo:41: 00000004:00000024:0.0:1788684091.519460:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788684091.519506:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085703680:12345-0@lo:41: Request processed in 146us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684091.519514:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684091.519563:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085703680:0@lo:41: 00010000:00010000:1.0:1788684092.032244:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684093.053512:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788684093.061262:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1788684094.077841:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684095.101654:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085704064:0@lo:400: 00000100:00100000:2.0:1788684095.101655:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085703808:0@lo:400: 00000100:00100000:1.0:1788684095.101741:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085704192:0@lo:400: 00000100:00100000:3.0:1788684095.101817:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085703936:0@lo:400: 00000100:00100000:0.0:1788684095.104715:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684095.104780:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085704576:0@lo:400: 00000100:00100000:0.0:1788684095.104807:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684095.104860:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085704576 00000100:00100000:0.0:1788684095.104867:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085704576 00000100:00100000:2.0:1788684095.106074:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684095.106113:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085704320:0@lo:400: 00000100:00100000:2.0:1788684095.106140:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684095.106156:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085704832:0@lo:400: 00000100:00100000:2.0:1788684095.106177:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684095.106223:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085704832 00000100:00100000:2.0:1788684095.106228:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085704832 00000100:00100000:2.0:1788684095.106260:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684095.106268:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085704832:12345-0@lo:400: 00000100:00100000:2.0:1788684095.106322:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085704832:12345-0@lo:400: Request processed in 55us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684095.106329:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788684095.106376:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777063100 x1875571085704832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684095.106389:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085704832:0@lo:400: 00000100:00100000:2.0:1788684095.106803:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085704064 00000100:00100000:2.0:1788684095.106809:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085704064 00000100:00100000:0.0:1788684095.106831:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788684095.106839:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085704320 00000100:00100000:2.0:1788684095.106843:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085704320 00000100:00100000:0.0:1788684095.106845:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085704576:12345-0@lo:400: 00000100:00100000:2.0:1788684095.106859:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788684095.106867:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085704064:12345-0@lo:400: 00000100:00100000:2.0:1788684095.106913:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085704064:12345-0@lo:400: Request processed in 47us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684095.106918:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085704576:12345-0@lo:400: Request processed in 64us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684095.106921:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684095.106933:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788684095.106937:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788684095.106945:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085704320:12345-0@lo:400: 00000100:00080000:0.0:1788684095.106960:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684095.106966:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684095.106978:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085704320:12345-0@lo:400: Request processed in 34us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684095.106986:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684095.107005:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085704064:0@lo:400: 00000100:00100000:2.0:1788684095.107019:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085704320:0@lo:400: 00010000:00080000:0.0:1788684095.107026:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777062680 x1875571085704576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684095.107038:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085704576:0@lo:400: 00000100:00100000:0.0:1788684095.107508:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085703808 00000100:00100000:0.0:1788684095.107514:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085703808 00000100:00100000:0.0:1788684095.107560:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788684095.107567:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3624:x1875571085703808:12345-0@lo:400: 00000100:00100000:0.0:1788684095.108597:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3624:x1875571085703808:12345-0@lo:400: Request processed in 1024us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684095.108605:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788684095.108816:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085703808:0@lo:400: 00000100:00100000:1.0:1788684095.110195:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684095.110297:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085704704:0@lo:400: 00000100:00100000:1.0:1788684095.110330:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684095.110412:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085704704 00000100:00100000:2.0:1788684095.110420:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085704704 00000100:00100000:2.0:1788684095.110511:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684095.110519:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085704704:12345-0@lo:400: 00000100:00100000:2.0:1788684095.110569:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085704704:12345-0@lo:400: Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684095.110576:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684095.111305:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085704192 00000100:00100000:0.0:1788684095.111313:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085704192 00000100:00100000:0.0:1788684095.111355:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788684095.111379:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085704192:12345-0@lo:400: 00000100:00100000:0.0:1788684095.111580:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085704192:12345-0@lo:400: Request processed in 217us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684095.111587:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788684095.112245:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788684095.112285:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777061c00 x1875571085704192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684095.112301:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085704192:0@lo:400: 00010000:00080000:1.0:1788684095.112314:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777060e00 x1875571085704704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684095.112322:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788684095.112337:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085704704:0@lo:400: 00000100:00100000:3.0:1788684095.112790:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684095.112820:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085704448:0@lo:400: 00000100:00100000:3.0:1788684095.112863:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684095.112945:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684095.113002:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085703936 00000100:00100000:1.0:1788684095.113009:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085703936 00000100:00100000:0.0:1788684095.113020:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085704448 00000100:00100000:0.0:1788684095.113026:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085704448 00000100:00100000:1.0:1788684095.113056:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788684095.113066:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085703936:12345-0@lo:400: 00000100:00100000:0.0:1788684095.113077:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788684095.113087:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085704448:12345-0@lo:400: 00000100:00100000:1.0:1788684095.113124:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085703936:12345-0@lo:400: Request processed in 59us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684095.113132:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788684095.113137:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085704448:12345-0@lo:400: Request processed in 50us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684095.113145:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788684095.113171:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777060a80 x1875571085703936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684095.113183:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085703936:0@lo:400: 00010000:00080000:1.0:1788684095.113204:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777061880 x1875571085704448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788684095.113211:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684095.113213:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085704448:0@lo:400: 00000100:00100000:0.0:1788684095.613575:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085704960:0@lo:13: 00000100:00100000:0.0:1788684095.613643:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684095.613714:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684095.613720:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085705088:0@lo:13: 00000100:00100000:0.0:1788684095.613741:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684095.613883:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085704960 00000100:00100000:1.0:1788684095.613891:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085704960 00000100:00100000:1.0:1788684095.613940:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085705088 00000100:00100000:1.0:1788684095.613943:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085705088 00000100:00100000:1.0:1788684095.613956:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788684095.613963:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085704960:12345-0@lo:13: 00002000:00000024:1.0:1788684095.613991:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684095.614055:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085704960:12345-0@lo:13: Request processed in 91us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684095.614061:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788684095.614077:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788684095.614083:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085705088:12345-0@lo:13: 00002000:00000024:1.0:1788684095.614093:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684095.614116:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085705088:12345-0@lo:13: Request processed in 34us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684095.614122:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788684095.614408:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6775ef5c00 x1875571085705088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684095.614439:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085705088:0@lo:13: 00010000:00080000:0.0:1788684095.614453:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777098700 x1875571085704960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684095.614464:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085704960:0@lo:13: 00010000:00010000:0.0:1788684096.126930:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684096.127054:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085705216:0@lo:41: 00000100:00100000:0.0:1788684096.127119:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.128862:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085705216 00000100:00100000:2.0:1788684096.128874:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085705216 00000100:00100000:2.0:1788684096.128924:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788684096.128933:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085705216:12345-0@lo:41: 00000004:00000024:2.0:1788684096.128965:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788684096.132848:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085705216:12345-0@lo:41: Request processed in 3906us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.132861:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788684096.135520:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085705216:0@lo:41: 00000020:01000004:2.0:1788684096.179961:0:9487:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788684096.179965:0:9487:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788684096.179967:0:9487:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788684096.180102:0:9487:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d67771bc800 00000020:01000004:2.0:1788684096.180116:0:9487:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788684096.180130:0:9487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788684096.180142:0:9487:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d677e1419c0) 00000020:00000080:2.0:1788684096.180157:0:9487:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788684096.226295:0:9487:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788684096.226341:0:9487:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788684096.265790:0:9487:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788684096.265988:0:9487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788684096.266001:0:9487:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788684096.266013:0:9487:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x44bac02bd54ac1a1 00000020:01000004:0.0:1788684096.266020:0:9487:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788684096.266040:0:9487:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788684096.266043:0:9487:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788684096.266049:0:9487:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788684096.266077:0:9487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788684096.266081:0:9487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788684096.287155:0:9487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788684096.287194:0:9487:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788684096.287199:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788684096.287201:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788684096.287202:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684096.287204:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684096.287205:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684096.287206:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684096.287208:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684096.287209:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788684096.287216:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788684096.287217:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684096.287218:0:9487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684096.287221:0:9487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788684096.287223:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684096.287225:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788684096.287226:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684096.287226:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684096.287227:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684096.287228:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684096.287229:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684096.287230:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788684096.287231:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788684096.287231:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684096.287232:0:9487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684096.287343:0:9487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788684096.287442:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085705344:0@lo:253: 00000100:00100000:1.0:1788684096.287511:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684096.287621:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67770fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788684096.287700:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085705344 00000100:00100000:3.0:1788684096.287708:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085705344 00000100:00100000:3.0:1788684096.287790:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788684096.287800:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:9487:x1875571085705344:12345-0@lo:253: 20000000:01000000:3.0:1788684096.287828:0:6489:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788684096.287831:0:6489:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788684096.287836:0:6489:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788684096.287838:0:6489:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788684096.288072:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684096.288207:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788684096.288221:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788684096.288238:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788684096.288243:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788684096.288273:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788684096.288290:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788684096.288412:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788684096.288428:0:6489:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:3.0:1788684096.288430:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:3.0:1788684096.288444:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788684096.288450:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788684096.288460:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788684096.288465:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:3.0:1788684096.288475:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788684096.288481:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788684096.288504:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788684096.288519:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788684096.288981:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788684096.288995:0:6489:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:3.0:1788684096.288996:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:3.0:1788684096.289012:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788684096.289017:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788684096.289034:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788684096.289039:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:3.0:1788684096.289052:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788684096.289057:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788684096.289070:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788684096.289086:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788684096.289616:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788684096.289629:0:6489:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:3.0:1788684096.289631:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:3.0:1788684096.289646:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788684096.289652:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788684096.289666:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788684096.289672:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:3.0:1788684096.289685:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788684096.289691:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788684096.289705:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788684096.289721:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788684096.289734:0:6489:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788684096.289737:0:6489:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788684096.289740:0:6489:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788684096.289781:0:6489:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788684096.289784:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788684096.290539:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788684096.290565:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788684096.290582:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788684096.290794:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788684096.290814:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788684096.290842:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788684096.290853:0:6489:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788684096.290855:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788684096.291127:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788684096.291145:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788684096.291163:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788684096.291765:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788684096.291786:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788684096.291798:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788684096.291807:0:6489:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788684096.291808:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788684096.292103:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788684096.292130:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788684096.292142:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788684096.292297:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788684096.292337:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1788684096.292353:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1788684096.292405:0:6489:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788684096.292408:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788684096.292730:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788684096.292748:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788684096.292764:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788684096.292880:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788684096.292899:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788684096.292913:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1788684096.292921:0:6489:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788684096.292923:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788684096.293230:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788684096.293716:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788684096.293738:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788684096.293754:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:1.0:1788684096.293769:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788684096.293788:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293805:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac097 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293814:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac0c1 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293822:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac100 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293841:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac11c expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293847:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac146 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293853:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac162 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293859:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac185 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293866:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293903:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac185 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.293916:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac185 expref: 21 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.293930:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085705472:0@lo:104: 00000100:00100000:1.0:1788684096.293987:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684096.294077:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac162 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.294086:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac162 expref: 21 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.294095:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085705600:0@lo:104: 00000100:00100000:1.0:1788684096.294126:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684096.294199:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac146 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.294207:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac146 expref: 21 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.294215:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085705728:0@lo:104: 00000100:00100000:1.0:1788684096.294236:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.294353:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085705472 00000100:00100000:2.0:1788684096.294360:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085705472 00000100:00100000:2.0:1788684096.294433:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085705600 00000100:00100000:2.0:1788684096.294437:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085705600 00000100:00100000:2.0:1788684096.294452:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788684096.294460:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6489:x1875571085705472:12345-0@lo:104: 00010000:00010000:2.0:1788684096.294472:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294560:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788684096.294567:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6489:x1875571085705472:12345-0@lo:104: Request processed in 108us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.294574:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788684096.294593:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684096.294600:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6489:x1875571085705600:12345-0@lo:104: 00010000:00010000:2.0:1788684096.294607:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294640:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788684096.294645:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6489:x1875571085705600:12345-0@lo:104: Request processed in 46us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.294651:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788684096.294667:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684096.294672:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294679:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d674148b600 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.294683:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294690:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.294697:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.294703:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684096.294737:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294743:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684096.294762:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294768:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d674148b600/0x44bac02bd54ac185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac18c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294783:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684096.294786:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294791:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030600 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.294794:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294800:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.294807:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.294812:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684096.294824:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294830:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684096.294843:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294860:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac169 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.294869:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.294870:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.294871:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.294877:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684096.294889:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085705856:0@lo:103: 00000100:00100000:2.0:1788684096.294918:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.294958:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085705984:0@lo:103: 00000100:00100000:2.0:1788684096.294981:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.295011:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085705856 00000100:00100000:2.0:1788684096.295016:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085705856 00010000:00010000:2.0:1788684096.295032:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac185 expref: 22 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684096.295050:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085705984 00000100:00100000:2.0:1788684096.295052:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085705984 00010000:00010000:2.0:1788684096.295061:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac162 expref: 23 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684096.295070:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788684096.295076:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3624:x1875571085705856:12345-0@lo:103: 00010000:00010000:2.0:1788684096.295085:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684096.295089:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac185 expref: 23 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.295099:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac185 expref: 23 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.295120:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684096.295148:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3624:x1875571085705856:12345-0@lo:103: Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.295154:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788684096.295167:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684096.295172:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3625:x1875571085705984:12345-0@lo:103: 00010000:00010000:2.0:1788684096.295180:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684096.295184:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac162 expref: 22 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.295191:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac162 expref: 22 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.295200:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684096.295223:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3625:x1875571085705984:12345-0@lo:103: Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.295228:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788684096.295569:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac11c expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.295580:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac11c expref: 21 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.295589:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085706112:0@lo:104: 00000100:00100000:1.0:1788684096.295612:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.295665:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085705984:0@lo:103: 00000100:00100000:2.0:1788684096.295693:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085705856:0@lo:103: 00010000:00010000:1.0:1788684096.295872:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac100 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.295881:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac100 expref: 21 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.295890:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085706240:0@lo:104: 00000100:00100000:1.0:1788684096.295936:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684096.295975:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085705728 00000100:00100000:0.0:1788684096.295980:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085705728 00000100:00100000:0.0:1788684096.296003:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085706112 00000100:00100000:0.0:1788684096.296005:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085706112 00000100:00100000:0.0:1788684096.296031:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788684096.296038:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6489:x1875571085705728:12345-0@lo:104: 00010000:00010000:0.0:1788684096.296047:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.296095:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684096.296100:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6489:x1875571085705728:12345-0@lo:104: Request processed in 64us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.296106:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788684096.296121:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788684096.296127:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6489:x1875571085706112:12345-0@lo:104: 00010000:00010000:0.0:1788684096.296134:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.296163:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788684096.296169:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6489:x1875571085706112:12345-0@lo:104: Request processed in 43us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.296183:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788684096.296239:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684096.296244:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296262:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d674148b200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.296266:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296284:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.296291:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.296297:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684096.296327:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296334:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684096.296347:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296354:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d674148b200/0x44bac02bd54ac146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac14d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296411:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684096.296416:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296421:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a7000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.296424:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296431:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.296438:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.296449:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684096.296464:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296470:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684096.296482:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296489:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac11c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac123 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296499:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.296500:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.296502:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684096.296512:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085706496:0@lo:103: 00000100:00100000:2.0:1788684096.296537:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.296571:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085706368:0@lo:103: 00000100:00100000:2.0:1788684096.296595:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.296619:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085706496 00000100:00100000:2.0:1788684096.296623:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085706496 00010000:00010000:2.0:1788684096.296640:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac11c expref: 22 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684096.296657:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085706368 00000100:00100000:2.0:1788684096.296660:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085706368 00010000:00010000:2.0:1788684096.296671:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac146 expref: 23 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684096.296684:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788684096.296696:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3623:x1875571085706496:12345-0@lo:103: 00010000:00010000:2.0:1788684096.296705:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684096.296709:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac11c expref: 23 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296718:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac11c expref: 23 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296731:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684096.296757:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3623:x1875571085706496:12345-0@lo:103: Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.296763:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788684096.296776:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684096.296781:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3626:x1875571085706368:12345-0@lo:103: 00010000:00010000:2.0:1788684096.296789:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684096.296792:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac146 expref: 22 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296800:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac146 expref: 22 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.296809:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684096.296833:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3626:x1875571085706368:12345-0@lo:103: Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.296839:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684096.296885:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085706368:0@lo:103: 00000100:00100000:2.0:1788684096.296905:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085706496:0@lo:103: 00010000:00010000:2.0:1788684096.296921:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684096.297281:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac0c1 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.297292:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac0c1 expref: 21 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.297313:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085706624:0@lo:104: 00000100:00100000:1.0:1788684096.297351:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684096.297621:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac097 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.297630:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac097 expref: 21 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.297637:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085706752:0@lo:104: 00000100:00100000:1.0:1788684096.297657:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67770fb840 going to sleep for 11 seconds 00010000:00010000:1.0:1788684096.297671:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148a200/0x44bac02bd54ac18c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac185 expref: 21 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.297681:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085705472:0@lo:104: 00010000:00010000:1.0:1788684096.297691:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac162 expref: 20 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.297699:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085705600:0@lo:104: 00010000:00010000:1.0:1788684096.297707:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac14d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac146 expref: 19 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.297715:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085705728:0@lo:104: 00010000:00010000:1.0:1788684096.297723:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac11c expref: 18 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684096.297730:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085706112:0@lo:104: 00000100:00100000:0.0:1788684096.297802:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788684096.297818:0:6480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684096.297829:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085706240 00000100:00100000:0.0:1788684096.297833:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085706240 00000100:00100000:0.0:1788684096.297854:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085706624 00000100:00100000:0.0:1788684096.297856:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085706624 00000100:00100000:0.0:1788684096.297862:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085706752 00000100:00100000:0.0:1788684096.297864:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085706752 00000100:00100000:0.0:1788684096.297873:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788684096.297878:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:6489:x1875571085706240:12345-0@lo:104: 00010000:00010000:0.0:1788684096.297887:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.297968:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684096.297974:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:6489:x1875571085706240:12345-0@lo:104: Request processed in 96us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.297980:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788684096.297996:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788684096.298002:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664648ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6489:x1875571085706624:12345-0@lo:104: 00010000:00010000:0.0:1788684096.298010:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684096.298054:0:6481:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:3.0:1788684096.298060:0:6481:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788684096.298066:0:6481:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1788684096.298120:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085706240:0@lo:104: 00000100:00100000:1.0:1788684096.298138:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085706624:0@lo:104: 00010000:00010000:2.0:1788684096.298168:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684096.298174:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.298181:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740031a00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.298185:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.298192:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.298199:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.298203:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684096.298273:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.298279:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684096.298300:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.298307:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740031a00/0x44bac02bd54ac100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac107 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.298316:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684096.298320:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.298325:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a6400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.298327:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.298341:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.298347:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.298351:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788684096.298409:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085706880:0@lo:103: 00000100:00100000:3.0:1788684096.298438:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684096.298658:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788684096.298665:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664648ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6489:x1875571085706624:12345-0@lo:104: Request processed in 664us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.298672:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788684096.298704:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788684096.298718:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777061500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6489:x1875571085706752:12345-0@lo:104: 00010000:00010000:0.0:1788684096.298726:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.298767:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684096.298772:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777061500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6489:x1875571085706752:12345-0@lo:104: Request processed in 56us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.298777:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788684096.298820:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788684096.298867:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6489:1875571085706752:0@lo:104: 00010000:00010000:1.0:1788684096.298895:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299009:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299016:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684096.299042:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299050:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a6400/0x44bac02bd54ac0c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac0c8 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299062:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.299064:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.299065:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684096.299080:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085706880 00000100:00100000:2.0:1788684096.299085:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085706880 00010000:00010000:2.0:1788684096.299102:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac100 expref: 18 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684096.299122:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788684096.299128:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:3624:x1875571085706880:12345-0@lo:103: 00010000:00010000:2.0:1788684096.299137:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684096.299141:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac100 expref: 18 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299157:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac100 expref: 18 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299171:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a6800/0x44bac02bd54ac107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac100 expref: 18 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299181:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684096.299216:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:3624:x1875571085706880:12345-0@lo:103: Request processed in 88us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.299222:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788684096.299342:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085707008:0@lo:103: 00000100:00100000:3.0:1788684096.299453:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.299540:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085706880:0@lo:103: 00000100:00100000:2.0:1788684096.299563:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085707008 00000100:00100000:2.0:1788684096.299568:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085707008 00010000:00010000:2.0:1788684096.299583:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac0c1 expref: 17 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684096.299601:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788684096.299607:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:3625:x1875571085707008:12345-0@lo:103: 00010000:00010000:2.0:1788684096.299615:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684096.299618:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac0c1 expref: 17 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299626:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac0c1 expref: 17 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299636:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a7e00/0x44bac02bd54ac0c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac0c1 expref: 17 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.299656:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684096.299683:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:3625:x1875571085707008:12345-0@lo:103: Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.299689:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788684096.299711:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085707008:0@lo:103: 00010000:00010000:3.0:1788684096.300248:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684096.300290:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684096.300293:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.300509:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.300518:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.300521:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.300529:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.300535:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.300541:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684096.300598:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.300605:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788684096.300642:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085707136:0@lo:103: 00000100:00100000:0.0:1788684096.300682:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684096.300750:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085707136 00000100:00100000:3.0:1788684096.300755:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085707136 00010000:00010000:3.0:1788684096.300774:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac097 expref: 16 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684096.300807:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684096.300814:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:3626:x1875571085707136:12345-0@lo:103: 00010000:00010000:3.0:1788684096.300823:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684096.300827:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac097 expref: 16 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300836:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac097 expref: 16 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300848:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac09e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac097 expref: 16 pid: 6489 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300859:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300867:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300879:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300886:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300893:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300898:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300913:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d674148aa00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684096.300917:0:6482:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300924:0:6482:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300938:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.300948:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684096.300994:0:6489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.301001:0:6489:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.301006:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788684096.301020:0:6489:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1788684096.301342:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.301350:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740030000/0x44bac02bd54ac097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac09e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.301410:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.301412:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.301413:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684096.302920:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3626:x1875571085707136:12345-0@lo:103: Request processed in 2099us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684096.302932:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788684096.303034:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085707136:0@lo:103: 00000100:00100000:1.0:1788684096.303594:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:9487:x1875571085705344:12345-0@lo:253: Request processed in 15793us (16082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.303604:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788684096.303665:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085705344:0@lo:253: 10000000:01000000:0.0:1788684096.303678:0:9487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788684096.303682:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788684096.303684:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788684096.303685:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684096.303686:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788684096.303688:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684096.303689:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684096.303690:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788684096.303692:0:9487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788684096.303693:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684096.303694:0:9487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788684096.303712:0:9487:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d67771bc800 from lustre-OST0001 10000000:01000000:0.0:1788684096.303740:0:9487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788684096.303742:0:9487:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788684096.303750:0:9487:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d67482e3380 local copy 10000000:01000000:0.0:1788684096.303754:0:9487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788684096.303787:0:9487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.304056:0:9487:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.304066:0:9487:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684096.304084:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707264:0@lo:101: 00000100:00100000:0.0:1788684096.304125:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684096.304198:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684096.304247:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085707264 00000100:00100000:1.0:1788684096.304325:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085707264 00000100:00100000:1.0:1788684096.304560:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788684096.304569:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+14:9487:x1875571085707264:12345-0@lo:101: 00010000:00010000:1.0:1788684096.304582:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684096.304595:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac1b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac1af expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.304616:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac1af expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.304627:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac1af expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.304643:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d674148ac00, rc 0) 00000100:00100000:1.0:1788684096.304689:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:9487:x1875571085707264:12345-0@lo:101: Request processed in 121us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.304695:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788684096.304762:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707264:0@lo:101: 00010000:00010000:0.0:1788684096.304776:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.304784:0:9487:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684096.304863:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707392:0@lo:501: 00000100:00100000:0.0:1788684096.304889:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684096.305019:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684096.305347:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085707392 00000100:00100000:2.0:1788684096.305353:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085707392 00000100:00100000:1.0:1788684096.305448:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788684096.305456:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:9487:x1875571085707392:12345-0@lo:501: 00000100:00100000:1.0:1788684096.305520:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:9487:x1875571085707392:12345-0@lo:501: Request processed in 64us (629us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788684096.305526:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788684096.305593:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707392:0@lo:501: 10000000:01000000:0.0:1788684096.305608:0:9487:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788684096.305626:0:9487:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788684096.305632:0:9487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.305640:0:9487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.305655:0:9487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.305672:0:9487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788684096.305696:0:9487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d67771bc800 10000000:01000000:0.0:1788684096.305701:0:9487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788684096.305706:0:9487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788684096.305709:0:9487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684096.305712:0:9487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788684096.305715:0:9487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788684096.305732:0:9487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.305739:0:9487:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.305746:0:9487:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684096.305757:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707520:0@lo:101: 00000100:00100000:0.0:1788684096.305783:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684096.305945:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788684096.305982:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085707520 00000100:00100000:3.0:1788684096.305987:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085707520 00000100:00100000:3.0:1788684096.306011:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788684096.306018:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:9487:x1875571085707520:12345-0@lo:101: 00010000:00010000:3.0:1788684096.306025:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684096.306034:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac1bd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.306051:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac1bd expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.306059:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac1bd expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.306067:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67820eea00, rc 0) 00000100:00100000:3.0:1788684096.306155:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085707520:12345-0@lo:101: Request processed in 137us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684096.306160:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:2.0:1788684096.306212:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684096.306219:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.306225:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.306229:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.306236:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.306242:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.306247:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684096.306341:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.306348:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788684096.306411:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085707648:0@lo:103: 00000100:00100000:3.0:1788684096.306440:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684096.306496:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.306505:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac1af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x44bac02bd54ac1b6 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.306529:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.306531:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.306533:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684096.306544:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085707648 00000100:00100000:2.0:1788684096.306548:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085707648 00000100:00100000:2.0:1788684096.306578:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684096.306585:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:3623:x1875571085707648:12345-0@lo:103: 00010000:00010000:2.0:1788684096.306594:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684096.306605:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac1b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac1af expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.306615:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684096.306730:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707520:0@lo:101: 00010000:00010000:0.0:1788684096.306743:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.306752:0:9487:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684096.306836:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707776:0@lo:501: 00000100:00100000:0.0:1788684096.306863:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684096.306897:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788684096.306945:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085707776 00000100:00100000:1.0:1788684096.306949:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085707776 00000100:00100000:1.0:1788684096.306978:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788684096.306985:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085707776:12345-0@lo:501: 00000100:00100000:1.0:1788684096.307079:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085707776:12345-0@lo:501: Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.307085:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788684096.307157:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707776:0@lo:501: 00000100:00100000:0.0:1788684096.307183:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707904:0@lo:503: 00000100:00100000:0.0:1788684096.307223:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684096.307244:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788684096.307381:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085707904 00000100:00100000:1.0:1788684096.307395:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085707904 00000100:00100000:1.0:1788684096.307425:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788684096.307432:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085707904:12345-0@lo:503: 00000100:00100000:1.0:1788684096.307507:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085707904:12345-0@lo:503: Request processed in 74us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.307513:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788684096.307821:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085707904:0@lo:503: 00000040:00080000:0.0:1788684096.308055:0:9487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788684096.308117:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708032:0@lo:502: 00000100:00100000:0.0:1788684096.308156:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684096.308193:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788684096.308259:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085708032 00000100:00100000:1.0:1788684096.308264:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085708032 00000100:00100000:1.0:1788684096.308306:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788684096.308313:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708032:12345-0@lo:502: 00000100:00100000:1.0:1788684096.308423:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708032:12345-0@lo:502: Request processed in 110us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.308429:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788684096.308471:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708032:0@lo:502: 00000040:00080000:1.0:1788684096.308683:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788684096.308710:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788684096.308724:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788684096.308736:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788684096.308747:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788684096.308758:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788684096.308778:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708160:0@lo:502: 00000100:00100000:1.0:1788684096.308813:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684096.308826:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684096.308962:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085708160 00000100:00100000:0.0:1788684096.308966:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085708160 00000100:00100000:0.0:1788684096.309000:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788684096.309008:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708160:12345-0@lo:502: 00000100:00100000:0.0:1788684096.309083:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708160:12345-0@lo:502: Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.309089:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788684096.309177:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708160:0@lo:502: 00000040:00080000:1.0:1788684096.309214:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788684096.309222:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1788684096.309779:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788684096.309786:0:9500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788684096.309791:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684096.309794:0:9500:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788684096.309799:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788684096.309812:0:9500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d677e3ecd40) 00000020:00000080:1.0:1788684096.309833:0:9500:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788684096.309838:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788684096.309927:0:9500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d67771bc800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788684096.309935:0:9500:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788684096.309941:0:9500:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x44bac02bd54ac1d2 00000100:00100000:2.0:1788684096.313425:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3623:x1875571085707648:12345-0@lo:103: Request processed in 6830us (6974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.313439:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684096.314446:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085707648:0@lo:103: 00010000:00010000:1.0:1788684096.315005:0:9500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1788684096.315278:0:9500:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788684096.317888:0:9500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788684096.318180:0:9500:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788684096.323003:0:9500:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788684096.323199:0:9500:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788684096.331898:0:9500:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788684096.334026:0:9500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788684096.334036:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684096.334042:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684096.334044:0:9500:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788684096.334047:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684096.334050:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684096.334051:0:9500:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788684096.334054:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788684096.334056:0:9500:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788684096.334077:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684096.334080:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684096.334081:0:9500:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788684096.334084:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788684096.336093:0:9487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788684096.336129:0:9487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788684096.336150:0:9487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.336162:0:9487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684096.336193:0:9487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67771bc800 from 1 10000000:01000000:0.0:1788684096.336196:0:9487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684096.336232:0:9487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.336242:0:9487:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.336399:0:9487:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684096.336423:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777060a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708288:0@lo:101: 00000100:00100000:0.0:1788684096.336480:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684096.336519:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684096.336583:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085708288 00000100:00100000:1.0:1788684096.336590:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085708288 00000100:00100000:1.0:1788684096.336634:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788684096.336644:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:9487:x1875571085708288:12345-0@lo:101: 00010000:00010000:1.0:1788684096.336656:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684096.336667:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac1d9 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.336687:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac1d9 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.336696:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac1d9 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.336712:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d674148aa00, rc 0) 00000100:00100000:1.0:1788684096.336756:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708288:12345-0@lo:101: Request processed in 113us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.336762:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788684096.336904:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777060a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708288:0@lo:101: 00010000:00010000:2.0:1788684096.336918:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.336927:0:9487:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684096.337929:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708416:0@lo:501: 00000100:00100000:2.0:1788684096.337993:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.338029:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684096.338411:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085708416 00000100:00100000:1.0:1788684096.338418:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085708416 00000100:00100000:1.0:1788684096.338450:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788684096.338458:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708416:12345-0@lo:501: 00000100:00100000:1.0:1788684096.338555:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708416:12345-0@lo:501: Request processed in 97us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.338562:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788684096.340804:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708416:0@lo:501: 00000100:00100000:2.0:1788684096.340867:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708544:0@lo:503: 00000100:00100000:2.0:1788684096.340933:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.340975:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684096.343178:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085708544 00000100:00100000:0.0:1788684096.343188:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085708544 00000100:00100000:0.0:1788684096.343234:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788684096.343243:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708544:12345-0@lo:503: 00000100:00100000:0.0:1788684096.343516:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708544:12345-0@lo:503: Request processed in 273us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.343523:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788684096.343668:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708544:0@lo:503: 00000040:00080000:2.0:1788684096.343888:0:9487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788684096.343957:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708672:0@lo:502: 00000100:00100000:2.0:1788684096.343996:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.344019:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684096.344071:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085708672 00000100:00100000:0.0:1788684096.344075:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085708672 00000100:00100000:0.0:1788684096.344249:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788684096.344265:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708672:12345-0@lo:502: 00000100:00100000:0.0:1788684096.344350:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708672:12345-0@lo:502: Request processed in 87us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.344399:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788684096.344473:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708672:0@lo:502: 00000040:00080000:2.0:1788684096.344665:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788684096.344691:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788684096.344712:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708800:0@lo:502: 00000100:00100000:2.0:1788684096.344749:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.345015:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684096.345056:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085708800 00000100:00100000:0.0:1788684096.345061:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085708800 00000100:00100000:0.0:1788684096.345084:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788684096.345090:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708800:12345-0@lo:502: 00000100:00100000:0.0:1788684096.345168:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708800:12345-0@lo:502: Request processed in 77us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.345175:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788684096.345268:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708800:0@lo:502: 00000040:00080000:2.0:1788684096.345312:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788684096.345320:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788684096.346163:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684096.346174:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684096.346176:0:9504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788684096.346183:0:9504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67771bc800 00000020:00000080:3.0:1788684096.346185:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788684096.346196:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684096.346198:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684096.346200:0:9504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788684096.346202:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788684096.346475:0:9487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788684096.346495:0:9487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684096.346514:0:9487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.346524:0:9487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.346566:0:9487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788684096.346575:0:9487:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d67771bc800 10000000:01000000:2.0:1788684096.346578:0:9487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d67771bc800 10000000:01000000:2.0:1788684096.346581:0:9487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788684096.346587:0:9487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67771bc800 from 1 10000000:01000000:2.0:1788684096.346589:0:9487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788684096.346616:0:9487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.346624:0:9487:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.346633:0:9487:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684096.346649:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708928:0@lo:101: 00000100:00100000:2.0:1788684096.346693:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.346764:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684096.346804:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085708928 00000100:00100000:0.0:1788684096.346809:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085708928 00000100:00100000:0.0:1788684096.346849:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788684096.346858:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9487:x1875571085708928:12345-0@lo:101: 00010000:00010000:0.0:1788684096.346867:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684096.346879:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac1e7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.346899:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac1e7 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.346910:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac1e7 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.346919:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740031800, rc 0) 00000100:00100000:0.0:1788684096.346965:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085708928:12345-0@lo:101: Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.346972:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788684096.347204:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085708928:0@lo:101: 00010000:00010000:3.0:1788684096.347223:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.347232:0:9487:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684096.347482:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085709056:0@lo:501: 00000100:00100000:3.0:1788684096.347512:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684096.347538:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777249480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684096.347580:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085709056 00000100:00100000:1.0:1788684096.347586:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085709056 00000100:00100000:1.0:1788684096.347617:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788684096.347624:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085709056:12345-0@lo:501: 00000100:00100000:1.0:1788684096.347756:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085709056:12345-0@lo:501: Request processed in 131us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.347764:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788684096.347819:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085709056:0@lo:501: 00000100:00100000:3.0:1788684096.347844:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085709184:0@lo:503: 00000100:00100000:3.0:1788684096.347889:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684096.347911:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777249480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684096.347965:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085709184 00000100:00100000:2.0:1788684096.347970:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085709184 00000100:00100000:2.0:1788684096.347996:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788684096.348002:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085709184:12345-0@lo:503: 00000100:00100000:2.0:1788684096.348118:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085709184:12345-0@lo:503: Request processed in 115us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.348125:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788684096.348191:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085709184:0@lo:503: 00000040:00080000:3.0:1788684096.349128:0:9487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788684096.349208:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085709312:0@lo:502: 00000100:00100000:3.0:1788684096.349250:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684096.349281:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777249480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684096.349333:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085709312 00000100:00100000:1.0:1788684096.349338:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085709312 00000100:00100000:1.0:1788684096.349453:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788684096.349460:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085709312:12345-0@lo:502: 00000100:00100000:1.0:1788684096.349546:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085709312:12345-0@lo:502: Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.349553:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788684096.349957:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085709312:0@lo:502: 00000040:00080000:3.0:1788684096.350214:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788684096.350240:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788684096.350255:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788684096.350268:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788684096.350281:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788684096.350294:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788684096.350307:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788684096.350335:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788684096.350351:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788684096.352485:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788684096.352620:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788684096.352643:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788684096.352659:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788684096.352675:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788684096.352690:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788684096.352719:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788684096.352732:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788684096.352745:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788684096.352757:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788684096.352768:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788684096.352780:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788684096.352792:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788684096.352804:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788684096.352819:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788684096.352833:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788684096.352846:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788684096.352858:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788684096.352871:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788684096.352887:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788684096.352902:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788684096.352914:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788684096.352927:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788684096.352939:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788684096.352969:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788684096.352985:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788684096.352999:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788684096.353012:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788684096.353025:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788684096.353039:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788684096.353052:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788684096.353066:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788684096.353078:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788684096.353092:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788684096.353106:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788684096.353119:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788684096.353133:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788684096.353174:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085709440:0@lo:502: 00000100:00100000:2.0:1788684096.353331:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.353480:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684096.353724:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085709440 00000100:00100000:0.0:1788684096.353732:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085709440 00000100:00100000:0.0:1788684096.353815:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788684096.353824:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085709440:12345-0@lo:502: 00000100:00100000:0.0:1788684096.353939:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085709440:12345-0@lo:502: Request processed in 116us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.353945:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788684096.354025:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085709440:0@lo:502: 00000040:00080000:2.0:1788684096.354073:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788684096.354082:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788684096.354740:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788684096.354761:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d6647430000) 00000020:00000080:2.0:1788684096.354784:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788684096.354873:0:9505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d67771bc800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788684096.354877:0:9505:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d67771bc800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788684096.354880:0:9505:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67771bc800 3 00010000:00080000:2.0:1788684096.354907:0:9505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d664740b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684096.358898:0:9505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788684096.359156:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788684096.359198:0:9505:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788684096.359209:0:9505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x44bac02bd54ac1fc 00000100:00080000:2.0:1788684096.359218:0:9505:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684096.359224:0:9505:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d664740b800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684096.359256:0:9505:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66459bc000 x1875571085709568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684096.359282:0:9505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788684096.359553:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085709568:0@lo:38: 00000100:00100000:0.0:1788684096.359627:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.361463:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085709568 00000100:00100000:2.0:1788684096.361474:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085709568 00000100:00100000:2.0:1788684096.361513:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684096.361521:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1875571085709568:12345-0@lo:38: 00010000:00080000:2.0:1788684096.361553:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:2.0:1788684096.361617:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x44bac02bd54ac203 00000004:00100000:2.0:1788684096.361636:0:6499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788684096.361665:0:6499:0:(import.c:65:import_set_state_nolock()) ffff8d6647408000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684096.361737:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875571085709568:12345-0@lo:38: Request processed in 215us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.361744:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788684096.361789:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66459bc000 x1875571085709568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684096.361799:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684096.361806:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788684096.361812:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788684096.361816:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788684096.361818:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664740b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788684096.361823:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085709568:0@lo:38: 00000100:00100000:0.0:1788684096.362288:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788684096.362463:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684096.362475:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085710080:0@lo:400: 00000100:00100000:2.0:1788684096.362530:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.362582:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085709824:0@lo:400: 00000100:00100000:2.0:1788684096.362613:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.362633:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684096.362639:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085709952:0@lo:400: 00000100:00100000:2.0:1788684096.362667:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.362694:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085710080 00000100:00100000:2.0:1788684096.362699:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085710080 00000100:00100000:2.0:1788684096.362730:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085709952 00000100:00100000:2.0:1788684096.362734:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085709952 00000100:00100000:2.0:1788684096.362758:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684096.362765:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085710080:12345-0@lo:400: 00000100:00100000:2.0:1788684096.362814:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085710080:12345-0@lo:400: Request processed in 49us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.362822:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684096.362839:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684096.362845:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085709952:12345-0@lo:400: 00000100:00100000:2.0:1788684096.362879:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085709952:12345-0@lo:400: Request processed in 34us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.362885:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684096.362904:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085709824 00000100:00100000:2.0:1788684096.362907:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085709824 00000100:00100000:2.0:1788684096.362932:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684096.362939:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085709824:12345-0@lo:400: 00000100:00100000:2.0:1788684096.362970:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085709824:12345-0@lo:400: Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.362976:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788684096.363013:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677709b800 x1875571085709952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684096.363024:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085709952:0@lo:400: 00000100:00100000:2.0:1788684096.363036:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085709824:0@lo:400: 00010000:00080000:2.0:1788684096.363062:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677709a300 x1875571085710080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684096.363070:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085710080:0@lo:400: 00000020:01000004:2.0:1788684096.363164:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788684096.363178:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d6647434d40) 00000020:00000080:2.0:1788684096.363198:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:1.0:1788684096.363227:0:9506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9506:1875571085710208:0@lo:901: 00000020:01000004:2.0:1788684096.363276:0:9505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d67771bc800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788684096.363280:0:9505:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d67771bc800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788684096.363282:0:9505:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67771bc800 3 00010000:00080000:2.0:1788684096.363317:0:9505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677e50e000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.144@tcp at head 00000100:00100000:1.0:1788684096.363479:0:9506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684096.363509:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085710208 00000100:00100000:1.0:1788684096.363513:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085710208 00000100:00100000:1.0:1788684096.363550:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684096.363558:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9506:x1875571085710208:12345-0@lo:901: 00000100:00100000:1.0:1788684096.363632:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9506:x1875571085710208:12345-0@lo:901: Request processed in 75us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.363638:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788684096.363656:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684096.363669:0:9506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67770fb180 going to sleep for 11 seconds 00010000:00080000:1.0:1788684096.363683:0:9506:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6646d31180 x1875571085710208/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788684112 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684096.363692:0:9506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9506:1875571085710208:0@lo:901: 00000100:00100000:1.0:1788684096.366223:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085709696:0@lo:400: 00000100:00100000:1.0:1788684096.366296:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684096.366339:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684096.366350:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085710336:0@lo:400: 00000100:00100000:3.0:1788684096.366434:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085710592:0@lo:400: 00000100:00100000:1.0:1788684096.366578:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684096.366597:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684096.366669:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684096.366677:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085710464:0@lo:400: 00000100:00100000:1.0:1788684096.366685:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085709696 00000100:00100000:1.0:1788684096.366693:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085709696 00000100:00100000:3.0:1788684096.366706:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684096.366744:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085710336 00000100:00100000:1.0:1788684096.366748:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085710336 00000100:00100000:1.0:1788684096.366779:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684096.366789:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085709696:12345-0@lo:400: 00000100:00100000:0.0:1788684096.366799:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085710592 00000100:00100000:0.0:1788684096.366805:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085710592 00000100:00100000:1.0:1788684096.366842:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085709696:12345-0@lo:400: Request processed in 55us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.366859:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684096.366881:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788684096.366881:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085710464 00000100:00100000:0.0:1788684096.366886:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085710464 00000100:00100000:1.0:1788684096.366893:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085710336:12345-0@lo:400: 00000100:00100000:1.0:1788684096.366925:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085710336:12345-0@lo:400: Request processed in 35us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.366932:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788684096.366975:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777099500 x1875571085710336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684096.366978:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788684096.366990:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085710592:12345-0@lo:400: 00000100:00100000:1.0:1788684096.366993:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085710336:0@lo:400: 00010000:00080000:1.0:1788684096.367006:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777098e00 x1875571085709696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684096.367014:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085709696:0@lo:400: 00000100:00100000:3.0:1788684096.367092:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085710592:12345-0@lo:400: Request processed in 105us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684096.367098:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788684096.367121:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684096.367128:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085710464:12345-0@lo:400: 00010000:00080000:1.0:1788684096.367135:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677709b480 x1875571085710592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684096.367146:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085710592:0@lo:400: 00000100:00100000:3.0:1788684096.367162:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085710464:12345-0@lo:400: Request processed in 33us (455us total) trans 0 rc 0/0 00010000:00080000:1.0:1788684096.367169:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6777099f80 x1875571085710464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684096.367170:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788684096.367183:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085710464:0@lo:400: 00010000:00010000:2.0:1788684096.367527:0:9505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788684096.367866:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788684096.367905:0:9505:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788684096.367917:0:9505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x44bac02bd54ac211 00000100:00080000:2.0:1788684096.367924:0:9505:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684096.367930:0:9505:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d677e50e000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684096.367967:0:9505:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66459bc700 x1875571085710720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684096.368041:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085710720:0@lo:38: 00000100:00100000:0.0:1788684096.368083:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684096.368130:0:9505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1788684096.370790:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788684096.371001:0:9487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788684096.371035:0:9487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788684096.371057:0:9487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.371067:0:9487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788684096.371117:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788684096.371120:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788684096.371121:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684096.371122:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684096.371124:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684096.371125:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684096.371126:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684096.371128:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684096.371129:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684096.371130:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684096.371131:0:9487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684096.371135:0:9487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788684096.371138:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684096.371139:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788684096.371140:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684096.371141:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684096.371142:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684096.371143:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684096.371144:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684096.371145:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684096.371146:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684096.371147:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684096.371155:0:9487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684096.371178:0:9487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788684096.371193:0:9487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085710848:0@lo:253: 00000100:00100000:3.0:1788684096.371261:0:9487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684096.371301:0:9487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777249480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684096.371410:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085710848 00000100:00100000:2.0:1788684096.371417:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085710848 00000100:00100000:0.0:1788684096.371428:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085710720 00000100:00100000:0.0:1788684096.371433:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085710720 00000100:00100000:2.0:1788684096.371464:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788684096.371464:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684096.371471:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085710720:12345-0@lo:38: 00000100:00100000:2.0:1788684096.371472:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085710848:12345-0@lo:253: 20000000:01000000:2.0:1788684096.371495:0:6489:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00080000:0.0:1788684096.371503:0:6497:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 20000000:01000000:2.0:1788684096.371508:0:6489:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000080:0.0:1788684096.371543:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x44bac02bd54ac218 00000004:00100000:0.0:1788684096.371556:0:6497:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788684096.371586:0:6497:0:(import.c:65:import_set_state_nolock()) ffff8d6646729800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684096.371659:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875571085710720:12345-0@lo:38: Request processed in 186us (3574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.371666:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788684096.371754:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66459bc700 x1875571085710720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684096.371764:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684096.371771:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788684096.371778:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788684096.371782:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788684096.371784:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677e50e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788684096.371790:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085710720:0@lo:38: 20000000:01000000:2.0:1788684096.384313:0:6489:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788684096.384329:0:6489:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788684096.384597:0:6513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788684096.384602:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788684096.384623:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.384641:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac10e expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.384649:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac154 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.384656:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.384695:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac154 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.384709:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac154 expref: 17 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684096.384722:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085710976:0@lo:104: 00000100:00100000:3.0:1788684096.384780:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684096.384834:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac10e expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684096.384843:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac10e expref: 17 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684096.384868:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085711104:0@lo:104: 00000100:00100000:3.0:1788684096.384892:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684096.384999:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777249900 going to sleep for 11 seconds 00000100:00100000:2.0:1788684096.385342:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9487:x1875571085710848:12345-0@lo:253: Request processed in 13868us (14079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.385352:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788684096.385513:0:9487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9487:1875571085710848:0@lo:253: 10000000:01000000:3.0:1788684096.385524:0:9487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788684096.385527:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684096.385529:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788684096.385531:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684096.385532:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684096.385533:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684096.385534:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684096.385545:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684096.385547:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788684096.385548:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788684096.385550:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684096.385551:0:9487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788684096.385565:0:9487:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788684096.385775:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085710976 00000100:00100000:1.0:1788684096.385782:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085710976 00000100:00100000:1.0:1788684096.385821:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085711104 00000100:00100000:1.0:1788684096.385824:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085711104 00000100:00100000:1.0:1788684096.385845:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788684096.385854:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6513:x1875571085710976:12345-0@lo:104: 00010000:00010000:1.0:1788684096.385874:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684096.385991:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788684096.386001:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6513:x1875571085711104:12345-0@lo:104: 00010000:00010000:0.0:1788684096.386028:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684096.386053:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788684096.386060:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:6513:x1875571085710976:12345-0@lo:104: Request processed in 208us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684096.386068:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788684096.386077:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788684096.386085:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:6513:x1875571085711104:12345-0@lo:104: Request processed in 85us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684096.386093:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788684096.386242:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085710976:0@lo:104: 00000100:00100000:1.0:1788684096.386256:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6513:1875571085711104:0@lo:104: 00010000:00010000:1.0:1788684096.386272:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388459:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684096.388470:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388480:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030a00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.388484:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388493:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.388499:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.388505:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684096.388567:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388574:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684096.388605:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388612:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740030a00/0x44bac02bd54ac154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac15b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388630:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684096.388645:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388652:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a6e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684096.388655:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388661:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684096.388667:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684096.388672:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684096.388687:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388693:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684096.388698:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388704:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac10e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.388720:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.388721:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684096.388723:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684096.388739:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085711360:0@lo:103: 00000100:00100000:2.0:1788684096.388796:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.388852:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684096.388858:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085711232:0@lo:103: 00000100:00100000:2.0:1788684096.388887:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684096.388916:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085711360 00000100:00100000:2.0:1788684096.388922:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085711360 00010000:00010000:2.0:1788684096.388948:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac10e expref: 17 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684096.388960:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085711232 00000100:00100000:0.0:1788684096.388966:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085711232 00000100:00100000:2.0:1788684096.388979:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788684096.388987:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac154 expref: 18 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684096.388992:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:3624:x1875571085711360:12345-0@lo:103: 00010000:00010000:2.0:1788684096.389010:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788684096.389012:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788684096.389017:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac10e expref: 18 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684096.389023:0:6482:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788684096.389032:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac10e expref: 18 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389046:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030c00/0x44bac02bd54ac115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac10e expref: 18 pid: 6491 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389059:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684096.389100:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:3624:x1875571085711360:12345-0@lo:103: Request processed in 112us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.389107:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788684096.389127:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788684096.389136:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:3624:x1875571085711232:12345-0@lo:103: 00000100:00100000:0.0:1788684096.389140:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085711360:0@lo:103: 00010000:00010000:2.0:1788684096.389145:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684096.389157:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac154 expref: 16 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389167:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac154 expref: 16 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389184:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740031c00/0x44bac02bd54ac15b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac154 expref: 16 pid: 6490 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389194:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389202:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788684096.389214:0:6484:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004612249s 00010000:00010000:2.0:1788684096.389219:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389226:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389233:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389240:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389246:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67820ee000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684096.389250:0:6484:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389257:0:6484:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389281:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684096.389301:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684096.389335:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3624:x1875571085711232:12345-0@lo:103: Request processed in 202us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684096.389342:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788684096.389481:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085711232:0@lo:103: 00010000:00010000:0.0:1788684096.389637:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.389646:0:6513:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684096.389653:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac21f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788684096.392043:0:9487:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788684096.392243:0:9487:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788684096.392487:0:9487:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788684096.392646:0:9487:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788684096.392905:0:9487:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00010000:00010000:3.0:1788684096.392973:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788684096.393115:0:9487:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788684096.396302:0:9487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788684096.404910:0:9487:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788684096.404918:0:9487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788684096.404955:0:9487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788684096.404995:0:9487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788684096.405011:0:9487:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788684096.405030:0:9487:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788684096.405880:0:9487:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788684096.406054:0:9487:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1788684096.639005:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684096.639077:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085711488:0@lo:41: 00000100:00100000:1.0:1788684096.639143:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684096.652138:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085711488 00000100:00100000:3.0:1788684096.652150:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085711488 00000100:00100000:3.0:1788684096.652200:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788684096.652209:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085711488:12345-0@lo:41: 00000004:00000024:3.0:1788684096.652243:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788684096.652323:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085711488:12345-0@lo:41: Request processed in 115us (13180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684096.652337:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788684096.652421:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085711488:0@lo:41: 00010000:00010000:0.0:1788684097.153543:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788684097.201322:0:9563:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684097.201789:0:9563:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788684098.177186:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684099.198300:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684100.235245:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684100.734140:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684100.734178:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085711616:0@lo:13: 00000100:00100000:0.0:1788684100.734245:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684100.734308:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085711616 00000100:00100000:0.0:1788684100.734315:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085711616 00000100:00100000:0.0:1788684100.734391:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684100.734401:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085711616:12345-0@lo:13: 00002000:00000024:0.0:1788684100.734428:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684100.734471:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085711616:12345-0@lo:13: Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684100.734478:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788684100.734505:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788684100.734532:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777063100 x1875571085711616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684100.734550:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085711616:0@lo:13: 00000100:00100000:2.0:1788684100.736021:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684100.736038:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085711744:0@lo:13: 00000100:00100000:2.0:1788684100.736090:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684100.736547:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085711744 00000100:00100000:0.0:1788684100.736555:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085711744 00000100:00100000:0.0:1788684100.736605:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684100.736614:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085711744:12345-0@lo:13: 00002000:00000024:0.0:1788684100.736633:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684100.736679:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085711744:12345-0@lo:13: Request processed in 66us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684100.736686:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788684100.737472:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788684100.737509:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66459bc700 x1875571085711744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684100.737528:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085711744:0@lo:13: 00000100:00100000:0.0:1788684101.245635:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684101.245655:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085711872:0@lo:41: 00000100:00100000:0.0:1788684101.245717:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684101.245817:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085711872 00000100:00100000:2.0:1788684101.245825:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085711872 00000100:00100000:2.0:1788684101.245878:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788684101.245888:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085711872:12345-0@lo:41: 00000004:00000024:2.0:1788684101.245920:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788684101.245968:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085711872:12345-0@lo:41: Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684101.245975:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788684101.246021:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085711872:0@lo:41: 00010000:00010000:0.0:1788684101.247707:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684101.759491:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085712000:0@lo:41: 00000100:00100000:0.0:1788684101.759566:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.759616:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085712512:0@lo:400: 00000100:00100000:0.0:1788684101.759642:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.759668:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085713024:0@lo:400: 00000100:00100000:0.0:1788684101.759690:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.759714:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788684101.759720:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085712128:0@lo:400: 00000100:00100000:0.0:1788684101.759748:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.759768:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085712640:0@lo:400: 00000100:00100000:0.0:1788684101.759789:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.759808:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085713152:0@lo:400: 00000100:00100000:0.0:1788684101.759828:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.759859:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085712256:0@lo:400: 00000100:00100000:0.0:1788684101.759880:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.759897:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085712768:0@lo:400: 00000100:00100000:0.0:1788684101.759917:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.759927:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085713280:0@lo:400: 00000100:00100000:0.0:1788684101.759958:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.759972:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788684101.759978:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085712384:0@lo:400: 00000100:00100000:0.0:1788684101.759997:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.760014:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085712896:0@lo:400: 00000100:00100000:0.0:1788684101.760032:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684101.760062:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085712000 00000100:00100000:0.0:1788684101.760069:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085712000 00000100:00100000:0.0:1788684101.760115:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085712384 00000100:00100000:0.0:1788684101.760118:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085712384 00000100:00100000:0.0:1788684101.760133:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684101.760140:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085712000:12345-0@lo:41: 00000004:00000024:0.0:1788684101.760167:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788684101.760204:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085712000:12345-0@lo:41: Request processed in 64us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760211:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684101.760224:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788684101.760229:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085712384:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760253:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085712384:12345-0@lo:400: Request processed in 25us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760259:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788684101.760272:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085712512 00000100:00100000:0.0:1788684101.760275:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085712512 00000100:00100000:0.0:1788684101.760289:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085712640 00000100:00100000:0.0:1788684101.760291:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085712640 00000100:00100000:0.0:1788684101.760308:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085713152 00000100:00100000:0.0:1788684101.760310:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085713152 00000100:00100000:0.0:1788684101.760320:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085712256 00000100:00100000:0.0:1788684101.760323:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085712256 00000100:00100000:0.0:1788684101.760331:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085712768 00000100:00100000:0.0:1788684101.760333:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085712768 00000100:00100000:0.0:1788684101.760345:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085713280 00000100:00100000:0.0:1788684101.760347:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085713280 00000100:00100000:0.0:1788684101.760387:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788684101.760394:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085712512:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760426:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085712512:12345-0@lo:400: Request processed in 33us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760432:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788684101.760451:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684101.760457:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085712640:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760486:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085712640:12345-0@lo:400: Request processed in 29us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760492:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684101.760503:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684101.760509:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085713152:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760541:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085713152:12345-0@lo:400: Request processed in 32us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760547:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684101.760558:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684101.760563:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085712256:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760587:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085712256:12345-0@lo:400: Request processed in 24us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760593:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684101.760603:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684101.760609:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085712768:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760634:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085712768:12345-0@lo:400: Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760640:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684101.760650:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684101.760656:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085713280:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760680:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085713280:12345-0@lo:400: Request processed in 24us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760685:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684101.760701:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085713024 00000100:00100000:0.0:1788684101.760710:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085713024 00000100:00100000:0.0:1788684101.760738:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085712896 00000100:00100000:0.0:1788684101.760741:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085712896 00000100:00100000:0.0:1788684101.760751:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684101.760756:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085713024:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760792:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085713024:12345-0@lo:400: Request processed in 35us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760798:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684101.760807:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684101.760812:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085712896:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760830:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085712896:12345-0@lo:400: Request processed in 19us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760836:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684101.760850:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085712128 00000100:00100000:0.0:1788684101.760853:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085712128 00000100:00100000:0.0:1788684101.760872:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788684101.760876:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3625:x1875571085712128:12345-0@lo:400: 00000100:00100000:0.0:1788684101.760899:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3625:x1875571085712128:12345-0@lo:400: Request processed in 23us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684101.760905:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1788684101.760942:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684101.760945:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684101.760970:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085712384:0@lo:400: 00010000:00080000:0.0:1788684101.760981:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6775ef7480 x1875571085712896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684101.760991:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085712896:0@lo:400: 00010000:00080000:0.0:1788684101.761000:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6751bc0380 x1875571085712256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684101.761014:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085712256:0@lo:400: 00010000:00080000:0.0:1788684101.761024:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6775ef4a80 x1875571085712768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684101.761031:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085712768:0@lo:400: 00010000:00080000:0.0:1788684101.761039:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa80a80 x1875571085713280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684101.761046:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085713280:0@lo:400: 00000100:00100000:0.0:1788684101.761078:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085712128:0@lo:400: 00010000:00080000:0.0:1788684101.761086:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6775ef4700 x1875571085712640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684101.761093:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085712640:0@lo:400: 00010000:00080000:0.0:1788684101.761102:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa82d80 x1875571085713152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684101.761110:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085713152:0@lo:400: 00000100:00100000:0.0:1788684101.761121:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085712000:0@lo:41: 00010000:00080000:0.0:1788684101.761130:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6775ef5500 x1875571085712512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684101.761137:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085712512:0@lo:400: 00010000:00080000:0.0:1788684101.761144:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6775ef5c00 x1875571085713024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684101.761151:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085713024:0@lo:400: 00010000:00010000:1.0:1788684102.279450:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788684102.583842:0:9853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788684103.295694:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788684103.646069:0:9905:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684103.646316:0:9905:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788684104.317691:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684105.345056:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684105.854727:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684105.854753:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085713408:0@lo:13: 00000100:00100000:3.0:1788684105.854822:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684105.855492:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085713408 00000100:00100000:0.0:1788684105.855500:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085713408 00000100:00100000:0.0:1788684105.855572:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684105.855583:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085713408:12345-0@lo:13: 00002000:00000024:0.0:1788684105.855613:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684105.855669:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085713408:12345-0@lo:13: Request processed in 88us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684105.855670:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085713536:0@lo:13: 00000100:00100000:0.0:1788684105.855676:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788684105.855697:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684105.855713:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1788684105.855787:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788684105.855791:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d677e122800 from 39 10000000:01000000:1.0:1788684105.855794:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788684105.855822:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.855848:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.855858:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684105.855873:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085713664:0@lo:101: 00000100:00100000:1.0:1788684105.855905:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788684105.855923:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa82d80 x1875571085713408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684105.855926:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743344540 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.855940:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085713408:0@lo:13: 00000100:00100000:2.0:1788684105.855964:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085713664 00000100:00100000:2.0:1788684105.855967:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085713664 00000100:00100000:2.0:1788684105.856003:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788684105.856009:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085713664:12345-0@lo:101: 00010000:00010000:2.0:1788684105.856018:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684105.856029:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac226 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.856048:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac226 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.856057:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac226 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.856065:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67560a6400, rc 0) 00000100:00100000:2.0:1788684105.856094:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085713664:12345-0@lo:101: Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.856099:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788684105.856483:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085713664:0@lo:101: 00010000:00010000:1.0:1788684105.856498:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.856506:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684105.856557:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085713792:0@lo:501: 00000100:00100000:1.0:1788684105.856582:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.856604:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743344540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684105.856618:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085713792 00000100:00100000:1.0:1788684105.856621:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085713792 00000100:00100000:1.0:1788684105.856647:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788684105.856653:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085713792:12345-0@lo:501: 00000100:00100000:1.0:1788684105.856922:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085713792:12345-0@lo:501: Request processed in 268us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.856929:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788684105.857136:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085713792:0@lo:501: 00000100:00100000:2.0:1788684105.857165:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085713920:0@lo:503: 00000100:00100000:2.0:1788684105.857264:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.857319:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66464806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.857492:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085713536 00000100:00100000:0.0:1788684105.857498:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085713536 00000100:00100000:0.0:1788684105.857548:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788684105.857550:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684105.857556:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085713536:12345-0@lo:13: 00002000:00000024:0.0:1788684105.857569:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684105.857618:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085713536:12345-0@lo:13: Request processed in 63us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.857624:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788684105.857655:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777098e00 x1875571085713536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684105.857869:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085713536:0@lo:13: 00000100:00100000:1.0:1788684105.857937:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085713920 00000100:00100000:1.0:1788684105.857942:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085713920 00000100:00100000:1.0:1788684105.857967:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788684105.857974:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085713920:12345-0@lo:503: 00000100:00100000:1.0:1788684105.858110:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085713920:12345-0@lo:503: Request processed in 136us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.858116:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788684105.858181:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085713920:0@lo:503: 00000100:00100000:0.0:1788684105.868522:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9976:1875571085714048:0@lo:502: 00000100:00100000:0.0:1788684105.868662:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684105.868698:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684105.868801:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085714048 00000100:00100000:1.0:1788684105.868808:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085714048 00000100:00100000:1.0:1788684105.868855:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788684105.868863:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9976:x1875571085714048:12345-0@lo:502: 00000100:00100000:1.0:1788684105.868993:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9976:x1875571085714048:12345-0@lo:502: Request processed in 130us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.869001:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788684105.869031:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9976:1875571085714048:0@lo:502: 00000100:00100000:3.0:1788684105.869082:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9976:1875571085714176:0@lo:502: 00000100:00100000:3.0:1788684105.869125:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.869147:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684105.869413:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085714176 00000100:00100000:1.0:1788684105.869418:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085714176 00000100:00100000:1.0:1788684105.869450:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788684105.869457:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9976:x1875571085714176:12345-0@lo:502: 00000100:00100000:1.0:1788684105.869532:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:9976:x1875571085714176:12345-0@lo:502: Request processed in 75us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.869540:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788684105.869616:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9976:1875571085714176:0@lo:502: 00000040:00080000:3.0:1788684105.869633:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788684105.869897:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788684105.869917:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788684105.869925:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.869936:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684105.869957:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788684105.869959:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788684105.869962:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788684105.869983:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.869991:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.870000:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684105.870012:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085714304:0@lo:101: 00000100:00100000:1.0:1788684105.870037:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.870065:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.870142:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085714304 00000100:00100000:0.0:1788684105.870147:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085714304 00000100:00100000:0.0:1788684105.870229:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788684105.870237:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085714304:12345-0@lo:101: 00010000:00010000:0.0:1788684105.870246:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684105.870262:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac234 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684105.870282:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac234 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684105.870292:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac234 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684105.870300:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740030400, rc 0) 00000100:00100000:0.0:1788684105.870350:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085714304:12345-0@lo:101: Request processed in 114us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.870356:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788684105.870395:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085714304:0@lo:101: 00010000:00010000:2.0:1788684105.870527:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.870537:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684105.870582:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085714432:0@lo:501: 00000100:00100000:2.0:1788684105.870606:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.876940:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085714432 00000100:00100000:1.0:1788684105.876952:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085714432 00000100:00100000:2.0:1788684105.876963:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66464806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.876991:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788684105.877000:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085714432:12345-0@lo:501: 00000100:00100000:2.0:1788684105.877673:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085714432:12345-0@lo:501: Request processed in 673us (7064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.877681:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788684105.880222:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085714432:0@lo:501: 00000100:00100000:0.0:1788684105.880278:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085714560:0@lo:503: 00000100:00100000:0.0:1788684105.880350:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684105.880409:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684105.880754:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085714560 00000100:00100000:1.0:1788684105.880761:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085714560 00000100:00100000:1.0:1788684105.880809:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788684105.880817:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085714560:12345-0@lo:503: 00000100:00100000:1.0:1788684105.880926:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085714560:12345-0@lo:503: Request processed in 109us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.880934:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788684105.881067:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085714560:0@lo:503: 00000100:00100000:3.0:1788684105.881464:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9977:1875571085714688:0@lo:502: 00000100:00100000:3.0:1788684105.881501:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.881522:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.881638:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085714688 00000100:00100000:0.0:1788684105.881643:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085714688 00000100:00100000:0.0:1788684105.881679:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788684105.881687:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9977:x1875571085714688:12345-0@lo:502: 00000100:00100000:0.0:1788684105.881771:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9977:x1875571085714688:12345-0@lo:502: Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.881779:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788684105.881902:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9977:1875571085714688:0@lo:502: 00000020:01000000:3.0:1788684105.881923:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684105.881930:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684105.881932:0:9977:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684105.881944:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684105.881947:0:9977:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788684105.881960:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9977:1875571085714816:0@lo:502: 00000100:00100000:3.0:1788684105.881998:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.882018:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.882062:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085714816 00000100:00100000:0.0:1788684105.882066:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085714816 00000100:00100000:0.0:1788684105.882129:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788684105.882135:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9977:x1875571085714816:12345-0@lo:502: 00000100:00100000:0.0:1788684105.882216:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:9977:x1875571085714816:12345-0@lo:502: Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.882222:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788684105.882276:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9977:1875571085714816:0@lo:502: 00000020:01000000:3.0:1788684105.882292:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684105.882296:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684105.882297:0:9977:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788684105.882302:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788684105.882854:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788684105.882875:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788684105.882884:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.882905:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684105.882913:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788684105.882916:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d677cc6f800 from 39 10000000:01000000:1.0:1788684105.882919:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788684105.882943:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.882951:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.882960:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684105.882973:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085714944:0@lo:101: 00000100:00100000:1.0:1788684105.883006:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.883040:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.883098:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085714944 00000100:00100000:0.0:1788684105.883103:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085714944 00000100:00100000:0.0:1788684105.883136:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788684105.883143:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085714944:12345-0@lo:101: 00010000:00010000:0.0:1788684105.883151:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684105.883162:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac242 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684105.883182:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac242 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684105.883191:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac242 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684105.883343:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740030000, rc 0) 00000100:00100000:0.0:1788684105.883530:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085714944:12345-0@lo:101: Request processed in 387us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.883616:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085714944:0@lo:101: 00010000:00010000:1.0:1788684105.883629:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.883639:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684105.883688:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715072:0@lo:501: 00000100:00100000:1.0:1788684105.883714:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.883749:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.883782:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788684105.883854:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085715072 00000100:00100000:3.0:1788684105.883859:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085715072 00000100:00100000:3.0:1788684105.883891:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788684105.883897:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085715072:12345-0@lo:501: 00000100:00100000:3.0:1788684105.883990:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085715072:12345-0@lo:501: Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684105.883996:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788684105.884091:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715072:0@lo:501: 00000100:00100000:1.0:1788684105.884115:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715200:0@lo:503: 00000100:00100000:1.0:1788684105.884147:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.884196:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684105.884288:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085715200 00000100:00100000:3.0:1788684105.884292:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085715200 00000100:00100000:3.0:1788684105.885350:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788684105.885362:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085715200:12345-0@lo:503: 00000100:00100000:3.0:1788684105.885492:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085715200:12345-0@lo:503: Request processed in 133us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684105.885499:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788684105.885693:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715200:0@lo:503: 00000100:00100000:1.0:1788684105.885907:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9978:1875571085715328:0@lo:502: 00000100:00100000:1.0:1788684105.885946:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684105.886071:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085715328 00000100:00100000:0.0:1788684105.886076:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085715328 00000100:00100000:0.0:1788684105.886103:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788684105.886110:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:9978:x1875571085715328:12345-0@lo:502: 00000100:00100000:0.0:1788684105.886184:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:9978:x1875571085715328:12345-0@lo:502: Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.886190:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788684105.889819:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684105.889858:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9978:1875571085715328:0@lo:502: 00000100:00100000:1.0:1788684105.889928:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9978:1875571085715456:0@lo:502: 00000100:00100000:1.0:1788684105.889993:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.890025:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085715456 00000100:00100000:1.0:1788684105.890031:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085715456 00000100:00100000:1.0:1788684105.890068:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788684105.890076:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:9978:x1875571085715456:12345-0@lo:502: 00000100:00100000:1.0:1788684105.890172:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:9978:x1875571085715456:12345-0@lo:502: Request processed in 97us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.890179:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788684105.890669:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684105.890684:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9978:1875571085715456:0@lo:502: 00000040:00080000:1.0:1788684105.890706:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788684105.891298:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788684105.891319:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788684105.891329:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.891352:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684105.891442:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788684105.891445:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d677cc6f800 from 6 10000000:01000000:2.0:1788684105.891447:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788684105.891479:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.891487:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.891496:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684105.891513:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715584:0@lo:101: 00000100:00100000:2.0:1788684105.892178:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.892313:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085715584 00000100:00100000:1.0:1788684105.892320:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085715584 00000100:00100000:1.0:1788684105.892435:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788684105.892444:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085715584:12345-0@lo:101: 00010000:00010000:1.0:1788684105.892463:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684105.892476:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac250 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.892497:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac250 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.892508:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac250 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.892515:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d674148ac00, rc 0) 00000100:00100000:1.0:1788684105.892551:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085715584:12345-0@lo:101: Request processed in 108us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.892557:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788684105.892626:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66464803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.892642:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715584:0@lo:101: 00010000:00010000:2.0:1788684105.892655:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.892663:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684105.892710:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715712:0@lo:256: 00000100:00100000:2.0:1788684105.892742:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.902049:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085715712 00000100:00100000:3.0:1788684105.902071:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085715712 00000100:00100000:2.0:1788684105.902096:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66464803c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.902280:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788684105.902294:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085715712:12345-0@lo:256: 20000000:01000000:0.0:1788684105.902317:0:6489:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788684105.902352:0:6489:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788684105.902355:0:6489:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788684105.902491:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085715712:12345-0@lo:256: Request processed in 202us (9747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.902499:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788684105.902659:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715712:0@lo:256: 10000000:01000000:2.0:1788684105.902710:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788684105.902725:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.902734:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684105.902743:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788684105.902745:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788684105.902748:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788684105.902777:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.902785:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.902797:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684105.902900:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715840:0@lo:101: 00000100:00100000:3.0:1788684105.902937:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684105.902990:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085715840 00000100:00100000:3.0:1788684105.902995:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1180 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.902996:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085715840 00000100:00100000:0.0:1788684105.903035:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788684105.903043:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085715840:12345-0@lo:101: 00010000:00010000:0.0:1788684105.903052:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684105.903064:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac25e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684105.903084:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac25e expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684105.903094:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac25e expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684105.903102:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740030800, rc 0) 00000100:00100000:0.0:1788684105.904034:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085715840:12345-0@lo:101: Request processed in 988us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.904042:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788684105.904074:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715840:0@lo:101: 00010000:00010000:3.0:1788684105.904102:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.904114:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684105.904190:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715968:0@lo:501: 00000100:00100000:3.0:1788684105.904227:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.904264:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684105.904284:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085715968 00000100:00100000:1.0:1788684105.904291:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085715968 00000100:00100000:1.0:1788684105.904330:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788684105.904351:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085715968:12345-0@lo:501: 00000100:00100000:1.0:1788684105.904527:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085715968:12345-0@lo:501: Request processed in 177us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.904545:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788684105.904888:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085715968:0@lo:501: 00000100:00100000:3.0:1788684105.904918:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085716096:0@lo:503: 00000100:00100000:3.0:1788684105.904971:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.904995:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684105.905019:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085716096 00000100:00100000:1.0:1788684105.905025:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085716096 00000100:00100000:1.0:1788684105.905058:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788684105.905066:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085716096:12345-0@lo:503: 00000100:00100000:1.0:1788684105.905150:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085716096:12345-0@lo:503: Request processed in 84us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.905157:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788684105.905428:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085716096:0@lo:503: 00000100:00100000:3.0:1788684105.905859:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9980:1875571085716224:0@lo:502: 00000100:00100000:3.0:1788684105.905909:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.905937:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.905977:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085716224 00000100:00100000:0.0:1788684105.905983:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085716224 00000100:00100000:0.0:1788684105.906016:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788684105.906029:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:9980:x1875571085716224:12345-0@lo:502: 00000100:00100000:0.0:1788684105.906121:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:9980:x1875571085716224:12345-0@lo:502: Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.906127:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788684105.906362:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9980:1875571085716224:0@lo:502: 00000020:01000000:3.0:1788684105.906449:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788684105.906456:0:9980:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788684105.906463:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684105.906465:0:9980:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788684105.906476:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788684105.906480:0:9980:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:3.0:1788684105.906499:0:9980:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788684105.906502:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684105.906521:0:9980:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d6777218000) 00000020:00000080:3.0:1788684105.906686:0:9980:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788684105.906694:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788684105.906783:0:9980:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788684105.906789:0:9980:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788684105.906796:0:9980:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ac273 00010000:00080000:3.0:1788684105.906826:0:9980:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677cef8000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684105.907051:0:9980:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788684105.907170:0:9980:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788684105.907181:0:9980:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788684105.907883:0:9980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684105.908007:0:9980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684105.908145:0:9980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788684105.908254:0:9980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788684105.909790:0:9981:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788684105.909795:0:9981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788684105.910431:0:9980:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788684105.910443:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788684105.910478:0:9980:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788684105.910501:0:9980:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ac27a 00000100:00080000:1.0:1788684105.910509:0:9980:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788684105.910515:0:9980:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d677cef8000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684105.910726:0:9980:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6646d30a80 x1875571085716352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684105.910772:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085716352:0@lo:8: 00000100:00100000:2.0:1788684105.910836:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788684105.910900:0:9980:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788684105.910955:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684105.910960:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684105.910961:0:9980:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788684105.910964:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684105.910968:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684105.910969:0:9980:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788684105.910972:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788684105.910974:0:9980:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788684105.910996:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9980:1875571085716480:0@lo:502: 00000100:00100000:1.0:1788684105.911039:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.911058:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684105.911111:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085716352 00000100:00100000:3.0:1788684105.911118:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085716352 00000100:00100000:3.0:1788684105.911154:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684105.911161:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1875571085716352:12345-0@lo:8: 00010000:00080000:3.0:1788684105.911184:0:8412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1788684105.911219:0:8412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ac281 00002000:00100000:3.0:1788684105.911231:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d677fa99000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788684105.911235:0:8412:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788684105.911239:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788684105.911289:0:8412:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788684105.911531:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788684105.911570:0:8412:0:(import.c:65:import_set_state_nolock()) ffff8d677fa9f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684105.918196:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085716864:0@lo:400: 00000100:00100000:3.0:1788684105.918264:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875571085716352:12345-0@lo:8: Request processed in 7100us (7425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684105.918281:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788684105.918292:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d30a80 x1875571085716352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684105.918302:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788684105.918311:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788684105.918318:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788684105.918323:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788684105.918326:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cef8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788684105.918347:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788684105.918353:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085716352:0@lo:8: 00000004:00080000:3.0:1788684105.918377:0:9981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788684105.918565:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.918600:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085717376:0@lo:400: 00000100:00100000:1.0:1788684105.918606:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085716864 00000100:00100000:1.0:1788684105.918613:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085716864 00000100:00100000:2.0:1788684105.918621:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.918641:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788684105.918647:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085717376 00000100:00100000:2.0:1788684105.918648:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085716736:0@lo:400: 00000100:00100000:1.0:1788684105.918649:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085717376 00000100:00100000:2.0:1788684105.918672:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684105.918673:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788684105.918681:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085716864:12345-0@lo:400: 00000100:00100000:1.0:1788684105.918730:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085716864:12345-0@lo:400: Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.918737:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788684105.918751:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788684105.918757:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085717376:12345-0@lo:400: 00000100:00100000:1.0:1788684105.918784:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085717376:12345-0@lo:400: Request processed in 27us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.918789:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000004:00080000:3.0:1788684105.919195:0:9981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 186912827822ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788684105.919204:0:9981:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788684105.919259:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875571085717632:0@lo:700: 00000100:00100000:3.0:1788684105.919320:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.919356:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745d43180 going to sleep for 11 seconds 00000100:00100000:3.0:1788684105.919407:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085716608:0@lo:400: 00000100:00100000:3.0:1788684105.919431:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.919536:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085717248:0@lo:400: 00000100:00100000:2.0:1788684105.919571:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085716736 00000100:00100000:2.0:1788684105.919581:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085716736 00000100:00100000:2.0:1788684105.919622:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684105.919629:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085716736:12345-0@lo:400: 00000100:00100000:2.0:1788684105.919670:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085716736:12345-0@lo:400: Request processed in 41us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.919677:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788684105.920569:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085717120:0@lo:400: 00000100:00100000:3.0:1788684105.920604:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.920629:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788684105.920636:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085716992:0@lo:400: 00000100:00100000:3.0:1788684105.920660:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.920678:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085717504:0@lo:400: 00000100:00100000:1.0:1788684105.920895:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085716608 00000100:00100000:1.0:1788684105.920902:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085716608 00000100:00100000:1.0:1788684105.920931:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085717120 00000100:00100000:1.0:1788684105.920934:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085717120 00000100:00100000:1.0:1788684105.920951:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788684105.920958:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085716608:12345-0@lo:400: 00000100:00100000:1.0:1788684105.921000:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085716608:12345-0@lo:400: Request processed in 42us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684105.921007:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788684105.921022:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788684105.921030:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085717120:12345-0@lo:400: 00000100:00100000:2.0:1788684105.921050:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085716992 00000100:00100000:2.0:1788684105.921054:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085716992 00000100:00100000:1.0:1788684105.921068:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085717120:12345-0@lo:400: Request processed in 39us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.921076:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788684105.921082:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085716992:12345-0@lo:400: 00000100:00100000:1.0:1788684105.921082:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788684105.921197:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085716992:12345-0@lo:400: Request processed in 114us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.921203:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788684105.921223:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085717632 00000100:00100000:2.0:1788684105.921227:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085717632 00000100:00100000:2.0:1788684105.921261:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684105.921267:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9982:x1875571085717632:12345-0@lo:700: 00000100:00100000:2.0:1788684105.921303:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8420:1875571085717760:0@lo:700: 00000100:00100000:3.0:1788684105.921529:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788684105.921562:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa83480 x1875571085716608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684105.921575:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085716608:0@lo:400: 00010000:00080000:3.0:1788684105.921585:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa80000 x1875571085717120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684105.921593:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085717120:0@lo:400: 00000100:00100000:3.0:1788684105.921615:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085716992:0@lo:400: 00000100:00100000:3.0:1788684105.921640:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085716480 00000100:00100000:3.0:1788684105.921649:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085716480 00000100:00100000:3.0:1788684105.921675:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788684105.921680:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:9980:x1875571085716480:12345-0@lo:502: 00000100:00100000:2.0:1788684105.921890:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.921912:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66464803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.921928:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085717504 00000100:00100000:2.0:1788684105.921931:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085717504 00000100:00100000:2.0:1788684105.921958:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788684105.921964:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085717504:12345-0@lo:400: 00000100:00100000:2.0:1788684105.922001:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085717504:12345-0@lo:400: Request processed in 37us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.922007:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788684105.922278:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:9980:x1875571085716480:12345-0@lo:502: Request processed in 597us (11238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684105.922284:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788684105.922459:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9980:1875571085716480:0@lo:502: 00000020:01000000:1.0:1788684105.922487:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684105.922494:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684105.922496:0:9980:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788684105.922501:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1788684105.922678:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085717760 00000020:01000000:3.0:1788684105.922917:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1788684105.922936:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788684105.923068:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.923079:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684105.923089:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 00000100:00100000:2.0:1788684105.923164:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085717760 00000100:00100000:2.0:1788684105.923205:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684105.923212:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8420:x1875571085717760:12345-0@lo:700: 00000100:00080000:2.0:1788684105.923314:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684105.923319:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684105.923321:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788684105.923363:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa82d80 x1875571085717504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684105.923397:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085717504:0@lo:400: 00000100:00100000:2.0:1788684105.923424:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1788684105.923585:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67466b4800 from 39 10000000:01000000:3.0:1788684105.923591:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788684105.923619:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.923627:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.923636:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684105.923651:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085717888:0@lo:101: 00000100:00100000:3.0:1788684105.923980:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.924016:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f000 going to sleep for 11 seconds 00010000:00080000:2.0:1788684105.924088:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa82a00 x1875571085716864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684105.924091:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085717888 00000100:00100000:1.0:1788684105.924096:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085717888 00000100:00100000:1.0:1788684105.924136:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788684105.924143:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085717888:12345-0@lo:101: 00010000:00010000:1.0:1788684105.924153:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684105.924166:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac288 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.924188:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac288 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684105.924211:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac288 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684105.924219:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085716864:0@lo:400: 00010000:00010000:1.0:1788684105.924220:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d674148b200, rc 0) 00010000:00080000:2.0:1788684105.924235:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa80a80 x1875571085717376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684105.924243:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085717376:0@lo:400: 00000100:00100000:1.0:1788684105.924262:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085717888:12345-0@lo:101: Request processed in 119us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.924267:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085716736:0@lo:400: 00000100:00100000:1.0:1788684105.924268:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788684105.924289:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085717248 00000100:00100000:2.0:1788684105.924292:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085717248 00000100:00100000:3.0:1788684105.924394:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085717888:0@lo:101: 00010000:00010000:3.0:1788684105.924413:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.924422:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684105.924484:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718016:0@lo:501: 00000100:00100000:3.0:1788684105.924513:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.924524:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.925172:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684105.925186:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085717248:12345-0@lo:400: 00000100:00100000:2.0:1788684105.925236:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085717248:12345-0@lo:400: Request processed in 55us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.925242:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788684105.925280:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788684105.925314:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa81f80 x1875571085717248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684105.925325:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085717248:0@lo:400: 00000100:00100000:0.0:1788684105.925662:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085718016 00000100:00100000:0.0:1788684105.925670:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085718016 00000100:00100000:0.0:1788684105.925705:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788684105.925713:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085718016:12345-0@lo:501: 00000100:00100000:0.0:1788684105.925827:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085718016:12345-0@lo:501: Request processed in 115us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.925833:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788684105.926037:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718016:0@lo:501: 00000100:00100000:0.0:1788684105.926074:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718144:0@lo:503: 00000100:00100000:0.0:1788684105.926124:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684105.926157:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800af9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684105.926174:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085718144 00000100:00100000:0.0:1788684105.926177:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085718144 00000100:00100000:0.0:1788684105.926195:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788684105.926206:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085718144:12345-0@lo:503: 00000100:00100000:0.0:1788684105.926312:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085718144:12345-0@lo:503: Request processed in 110us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.926318:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788684105.926399:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718144:0@lo:503: 00000100:00100000:3.0:1788684105.927975:0:9984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9984:1875571085718272:0@lo:502: 00000100:00100000:3.0:1788684105.928042:0:9984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.928080:0:9984:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.928195:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085718272 00000100:00100000:2.0:1788684105.928201:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085718272 00000100:00100000:2.0:1788684105.928242:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788684105.928250:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:9984:x1875571085718272:12345-0@lo:502: 00000100:00100000:0.0:1788684105.928666:0:9984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9984:1875571085718272:0@lo:502: 00000100:00100000:2.0:1788684105.928866:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:9984:x1875571085718272:12345-0@lo:502: Request processed in 615us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.928947:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788684105.929431:0:9984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9984:1875571085718400:0@lo:502: 00000100:00100000:0.0:1788684105.929480:0:9984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684105.929529:0:9984:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800af240 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.929629:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085718400 00000100:00100000:2.0:1788684105.929634:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085718400 00000100:00100000:2.0:1788684105.929665:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788684105.929672:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:9984:x1875571085718400:12345-0@lo:502: 00000100:00100000:2.0:1788684105.929757:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:9984:x1875571085718400:12345-0@lo:502: Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.929763:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000004:00080000:2.0:1788684105.933885:0:7428:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788684105.936735:0:9984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9984:1875571085718400:0@lo:502: 00000040:00080000:2.0:1788684105.936781:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788684105.937198:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788684105.937221:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788684105.937231:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.937242:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684105.937251:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788684105.937254:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d67466b4800 from 6 10000000:01000000:3.0:1788684105.937256:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788684105.937291:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.937299:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.937316:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684105.937996:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718528:0@lo:101: 00000100:00100000:3.0:1788684105.938065:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.938089:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085718528 00000100:00100000:2.0:1788684105.938097:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085718528 00000100:00100000:3.0:1788684105.938105:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.938139:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788684105.938152:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085718528:12345-0@lo:101: 00010000:00010000:2.0:1788684105.938165:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684105.938178:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac29d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac296 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.938219:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac296 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.938230:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac296 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.938239:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67560a7400, rc 0) 00000100:00100000:2.0:1788684105.938284:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085718528:12345-0@lo:101: Request processed in 134us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.938290:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788684105.941735:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718528:0@lo:101: 00010000:00010000:3.0:1788684105.941767:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.941781:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684105.941862:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718656:0@lo:256: 00000100:00100000:3.0:1788684105.942493:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.942543:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fd80 going to sleep for 11 seconds 40000000:02000000:0.0:1788684105.942761:0:6504:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1788684105.942883:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085718656 00000100:00100000:2.0:1788684105.942892:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085718656 00000100:00100000:2.0:1788684105.942942:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788684105.942951:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085718656:12345-0@lo:256: 20000000:01000000:2.0:1788684105.942977:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788684105.942996:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788684105.942999:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788684105.943096:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085718656:12345-0@lo:256: Request processed in 146us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.943104:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788684105.943148:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718656:0@lo:256: 10000000:01000000:2.0:1788684105.943197:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788684105.943207:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.943217:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684105.943237:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788684105.943239:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788684105.943242:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788684105.943270:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.943277:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.943286:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684105.943302:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718784:0@lo:101: 00000100:00100000:2.0:1788684105.943328:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.943356:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.943385:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085718784 00000100:00100000:2.0:1788684105.943389:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085718784 00000100:00100000:2.0:1788684105.943413:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788684105.943419:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085718784:12345-0@lo:101: 00010000:00010000:2.0:1788684105.943427:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684105.943438:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac2a4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.943457:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac2a4 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.943467:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac2a4 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.943485:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67560a6200, rc 0) 00000100:00100000:2.0:1788684105.943514:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085718784:12345-0@lo:101: Request processed in 94us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.943520:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788684105.943551:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718784:0@lo:101: 00010000:00010000:2.0:1788684105.943563:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.943571:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684105.943632:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718912:0@lo:501: 00000100:00100000:2.0:1788684105.943657:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.943670:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.943681:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085718912 00000100:00100000:2.0:1788684105.943684:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085718912 00000100:00100000:2.0:1788684105.943705:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788684105.943711:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085718912:12345-0@lo:501: 00000100:00100000:2.0:1788684105.943814:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085718912:12345-0@lo:501: Request processed in 102us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.943821:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788684105.943848:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085718912:0@lo:501: 00000100:00100000:2.0:1788684105.943871:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085719040:0@lo:503: 00000100:00100000:2.0:1788684105.943910:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.943924:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.943941:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085719040 00000100:00100000:2.0:1788684105.943945:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085719040 00000100:00100000:2.0:1788684105.943964:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788684105.943970:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085719040:12345-0@lo:503: 00000100:00100000:2.0:1788684105.944046:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085719040:12345-0@lo:503: Request processed in 76us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.944053:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788684105.944094:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085719040:0@lo:503: 00000100:00100000:2.0:1788684105.944593:0:9985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9985:1875571085719168:0@lo:502: 00000100:00100000:2.0:1788684105.944631:0:9985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.944651:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085719168 00000100:00100000:2.0:1788684105.944655:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085719168 00000100:00100000:2.0:1788684105.944694:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788684105.944702:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:9985:x1875571085719168:12345-0@lo:502: 00000100:00100000:2.0:1788684105.944779:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:9985:x1875571085719168:12345-0@lo:502: Request processed in 77us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.944785:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788684105.944818:0:9985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.944832:0:9985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9985:1875571085719168:0@lo:502: 00000020:01000000:2.0:1788684105.944857:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788684105.944863:0:9985:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788684105.944869:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684105.944871:0:9985:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788684105.944876:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788684105.944879:0:9985:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:2.0:1788684105.944898:0:9985:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788684105.944900:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684105.944916:0:9985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d6647433380) 00000020:00000080:2.0:1788684105.944938:0:9985:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788684105.944944:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788684105.945036:0:9985:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788684105.945041:0:9985:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788684105.945049:0:9985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ac2b9 00010000:00080000:2.0:1788684105.945075:0:9985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d664773d800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684105.947879:0:9985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788684105.948013:0:9985:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788684105.948028:0:9985:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788684105.948185:0:9985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684105.948304:0:9985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684105.950081:0:9985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788684105.950221:0:9985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788684105.955110:0:9986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788684105.955117:0:9986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788684105.957870:0:9985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788684105.957884:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788684105.957927:0:9985:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788684105.957951:0:9985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ac2c0 00000100:00080000:3.0:1788684105.957961:0:9985:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684105.957967:0:9985:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d664773d800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684105.958002:0:9985:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6777099f80 x1875571085719296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684105.958034:0:9985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788684105.958108:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684105.958119:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684105.958120:0:9985:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788684105.958125:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684105.958128:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684105.958129:0:9985:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684105.958132:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684105.958134:0:9985:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788684105.958161:0:9985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9985:1875571085719424:0@lo:502: 00000100:00100000:3.0:1788684105.958236:0:9985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.958267:0:9985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.958328:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085719296:0@lo:8: 00000100:00100000:2.0:1788684105.958389:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.958432:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085719424 00000100:00100000:2.0:1788684105.958438:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085719424 00000100:00100000:2.0:1788684105.958476:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788684105.958483:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:9985:x1875571085719424:12345-0@lo:502: 00000100:00100000:2.0:1788684105.958592:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:9985:x1875571085719424:12345-0@lo:502: Request processed in 109us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.958600:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788684105.958794:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085719296 00000100:00100000:3.0:1788684105.958799:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085719296 00000100:00100000:3.0:1788684105.958834:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684105.958840:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1875571085719296:12345-0@lo:8: 00010000:00080000:3.0:1788684105.958860:0:8413:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1788684105.958885:0:8413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ac2c7 00002000:00100000:3.0:1788684105.958897:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d677fa9a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788684105.958901:0:8413:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788684105.958903:0:8413:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788684105.958960:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788684105.958981:0:8413:0:(import.c:65:import_set_state_nolock()) ffff8d677fa98000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684105.959021:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875571085719296:12345-0@lo:8: Request processed in 179us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684105.959028:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684105.959062:0:9985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:9985:1875571085719424:0@lo:502: 00000020:01000000:3.0:1788684105.959088:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684105.959093:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684105.959095:0:9985:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788684105.959100:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788684105.959445:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788684105.959468:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788684105.959477:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.959499:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684105.959509:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788684105.959511:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d67482e3380 from 1 10000000:01000000:2.0:1788684105.959514:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788684105.959537:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.959545:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684105.959553:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684105.959566:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085719552:0@lo:101: 00000100:00100000:2.0:1788684105.959597:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.959631:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480cc0 going to sleep for 11 seconds 00010000:00080000:2.0:1788684105.959655:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777099f80 x1875571085719296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684105.959664:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684105.959671:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788684105.959693:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788684105.959698:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788684105.959700:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664773d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788684105.959712:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788684105.959716:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085719296:0@lo:8: 00000004:00080000:2.0:1788684105.959745:0:9986:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788684105.959790:0:9986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 186953423193ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788684105.959796:0:9986:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788684105.961867:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085719552 00000100:00100000:3.0:1788684105.961882:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085719552 00000100:00100000:3.0:1788684105.961939:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788684105.961949:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085719552:12345-0@lo:101: 00010000:00010000:3.0:1788684105.961964:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684105.961982:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac2ce expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.962010:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac2ce expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.962021:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac2ce expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.962030:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67820ef800, rc 0) 00000100:00100000:3.0:1788684105.962097:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085719552:12345-0@lo:101: Request processed in 150us (2499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684105.962104:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788684105.962154:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085719552:0@lo:101: 00010000:00010000:3.0:1788684105.962171:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.962181:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684105.962254:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085719680:0@lo:501: 00000100:00100000:3.0:1788684105.962289:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684105.962321:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788684105.962348:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085719680 00000100:00100000:3.0:1788684105.962359:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085719680 00000100:00100000:3.0:1788684105.962404:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788684105.962411:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085719680:12345-0@lo:501: 00000100:00100000:3.0:1788684105.962486:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085719680:12345-0@lo:501: Request processed in 75us (197us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788684105.962493:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788684105.962524:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085719680:0@lo:501: 10000000:01000000:3.0:1788684105.962553:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788684105.962561:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684105.962569:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684105.965946:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8420:x1875571085717760:12345-0@lo:700: Request processed in 42726us (44604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684105.965960:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788684105.969005:0:8420:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6780033800 x1875571085717760/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788684121 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684105.969025:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8420:1875571085717760:0@lo:700: 40000000:02000000:2.0:1788684105.969039:0:8420:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:0.0:1788684105.977057:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:0.0:1788684105.987932:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788684105.987943:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788684105.989092:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9982:x1875571085717632:12345-0@lo:700: Request processed in 67817us (69763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684105.989106:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788684105.991943:0:9982:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677709a300 x1875571085717632/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788684121 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684105.991963:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875571085717632:0@lo:700: 00000004:00080000:0.0:1788684105.993784:0:9987:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788684105.993791:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788684105.993815:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085719808:0@lo:13: 00000100:00100000:0.0:1788684105.993815:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1875571085719936:0@lo:7: 00000100:00100000:0.0:1788684105.996034:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684105.996314:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800afd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684105.996417:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085719936 00000100:00100000:2.0:1788684105.996426:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085719936 00000100:00100000:2.0:1788684105.996484:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684105.996492:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9987:x1875571085719936:12345-0@lo:7: 00000100:00080000:0.0:1788684105.996644:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684105.999405:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684106.003462:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085719808 00000100:00100000:0.0:1788684106.003474:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085719808 00000100:00100000:0.0:1788684106.003540:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684106.003550:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085719808:12345-0@lo:13: 00002000:00000024:0.0:1788684106.003582:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923836928 avail 3692314624 00000100:00100000:0.0:1788684106.003660:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085719808:12345-0@lo:13: Request processed in 111us (4258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684106.003667:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788684106.004043:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa80a80 x1875571085719808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684106.004064:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085719808:0@lo:13: 00002000:00080000:2.0:1788684106.008123:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788684106.008131:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000004:00080000:3.0:1788684106.010276:0:9982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788684106.010308:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875571085720192:0@lo:7: 00000100:00100000:3.0:1788684106.010417:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684106.010462:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788684106.010486:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085720064:0@lo:13: 00000100:00100000:3.0:1788684106.010511:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684106.010553:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085720064 00000100:00100000:3.0:1788684106.010560:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085720064 00000100:00100000:3.0:1788684106.010602:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684106.010611:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085720064:12345-0@lo:13: 00002000:00000024:3.0:1788684106.010630:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923836928 avail 3692314624 00000100:00100000:3.0:1788684106.010690:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085720064:12345-0@lo:13: Request processed in 80us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684106.010696:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788684106.010733:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777098000 x1875571085720064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684106.010750:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085720064:0@lo:13: 00000100:00100000:2.0:1788684106.010844:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9987:x1875571085719936:12345-0@lo:7: Request processed in 14350us (14816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684106.010853:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684106.010879:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085720192 00000100:00100000:2.0:1788684106.010883:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085720192 00000100:00100000:2.0:1788684106.010909:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788684106.010916:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9982:x1875571085720192:12345-0@lo:7: 00010000:00080000:3.0:1788684106.011766:0:9987:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa82a00 x1875571085719936/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788684121 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684106.011778:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1875571085719936:0@lo:7: 00000004:00080000:3.0:1788684106.011789:0:9987:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788684106.011816:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1875571085720320:0@lo:5: 00000100:00100000:3.0:1788684106.011851:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684106.011865:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788684106.012427:0:8412:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788684106.012436:0:8412:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788684106.020437:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085720320 00000100:00100000:3.0:1788684106.020449:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085720320 00000100:00100000:1.0:1788684106.020523:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788684106.020533:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9987:x1875571085720320:12345-0@lo:5: 00002000:00080000:1.0:1788684106.020563:0:9991:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788684106.020566:0:9991:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788684106.028195:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9987:x1875571085720320:12345-0@lo:5: Request processed in 7658us (16338us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788684106.028217:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788684106.028393:0:9987:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa6bb80 x1875571085720320/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684122 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684106.028410:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1875571085720320:0@lo:5: 00000004:00080000:0.0:1788684106.028436:0:9987:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788684106.028474:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1875571085720448:0@lo:700: 00000100:00100000:0.0:1788684106.028507:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684106.028529:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800af840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684106.028582:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085720448 00000100:00100000:1.0:1788684106.028588:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085720448 00000100:00100000:1.0:1788684106.028637:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788684106.028645:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9987:x1875571085720448:12345-0@lo:700: 00002000:00080000:0.0:1788684106.040603:0:8411:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788684106.040614:0:8411:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788684106.040706:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9982:x1875571085720192:12345-0@lo:7: Request processed in 29786us (30286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684106.040717:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788684106.040725:0:9982:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777099f80 x1875571085720192/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788684122 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684106.040741:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875571085720192:0@lo:7: 00000004:00080000:3.0:1788684106.040758:0:9982:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788684106.040805:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875571085720576:0@lo:5: 00000100:00100000:3.0:1788684106.040843:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684106.040891:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684106.041094:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085720576 00000100:00100000:0.0:1788684106.041103:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085720576 00000100:00100000:0.0:1788684106.041157:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788684106.041167:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9982:x1875571085720576:12345-0@lo:5: 00002000:00080000:0.0:1788684106.041209:0:8413:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788684106.041251:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9982:x1875571085720576:12345-0@lo:5: Request processed in 86us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684106.041257:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788684106.041269:0:9982:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa6a680 x1875571085720576/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684122 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684106.041281:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875571085720576:0@lo:5: 00000004:00080000:3.0:1788684106.041291:0:9982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788684106.041315:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875571085720704:0@lo:5: 00000100:00100000:3.0:1788684106.041354:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684106.041400:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684106.041514:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085720704 00000100:00100000:0.0:1788684106.041519:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085720704 00000100:00100000:0.0:1788684106.041554:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684106.041563:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9982:x1875571085720704:12345-0@lo:5: 00002000:00080000:0.0:1788684106.041588:0:9991:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788684106.045962:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9982:x1875571085720704:12345-0@lo:5: Request processed in 4393us (4600us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788684106.045976:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00080000:1.0:1788684106.046120:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1788684106.047466:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9987:x1875571085720448:12345-0@lo:700: Request processed in 18816us (18952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684106.047498:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788684106.047552:0:9987:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa80a80 x1875571085720448/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788684122 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684106.047564:0:9987:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788684106.047580:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1875571085720448:0@lo:700: 00010000:00080000:2.0:1788684106.047736:0:9982:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa6a680 x1875571085720704/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684122 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684106.047748:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875571085720704:0@lo:5: 00000004:00080000:2.0:1788684106.047765:0:9982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788684106.047806:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9982:1875571085720832:0@lo:900: 00000100:00100000:2.0:1788684106.047845:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684106.047965:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684106.048012:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085720832 00000100:00100000:0.0:1788684106.048019:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085720832 00000100:00100000:0.0:1788684106.048101:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684106.048110:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9982:x1875571085720832:12345-0@lo:900: 00000100:00100000:0.0:1788684106.048158:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9982:x1875571085720832:12345-0@lo:900: Request processed in 49us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684106.048165:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788684106.048225:0:9982:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6780033800 x1875571085720832/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788684122 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684106.048235:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9982:1875571085720832:0@lo:900: 00000004:02000040:2.0:1788684106.049795:0:9987:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788684106.055565:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1875571085720960:0@lo:5: 00000100:00100000:2.0:1788684106.055643:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684106.055683:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085720960 00000100:00100000:2.0:1788684106.055690:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085720960 00000100:00100000:2.0:1788684106.055737:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788684106.055746:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9987:x1875571085720960:12345-0@lo:5: 00000100:00100000:3.0:1788684106.060439:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11d80 going to sleep for 11 seconds 00002000:00080000:2.0:1788684106.073624:0:8413:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788684106.073646:0:8413:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788684106.075164:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9987:x1875571085720960:12345-0@lo:5: Request processed in 19413us (19515us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788684106.075176:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788684106.075451:0:9987:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6780033800 x1875571085720960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684122 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684106.075470:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1875571085720960:0@lo:5: 00000004:00080000:0.0:1788684106.075485:0:9987:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:3.0:1788684106.323522:0:10017:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684106.323748:0:10017:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684106.366496:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684106.369243:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085721088:0@lo:41: 00000100:00100000:3.0:1788684106.369311:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684106.369416:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085721088 00000100:00100000:1.0:1788684106.369424:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085721088 00000100:00100000:1.0:1788684106.369481:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788684106.369490:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085721088:12345-0@lo:41: 00000004:00000024:1.0:1788684106.369521:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684106.380708:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085721088:12345-0@lo:41: Request processed in 11209us (11387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684106.380723:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788684106.381211:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085721088:0@lo:41: 00000100:00100000:3.0:1788684106.877558:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085721216:0@lo:41: 00000100:00100000:3.0:1788684106.877624:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684106.877731:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085721216 00000100:00100000:0.0:1788684106.877738:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085721216 00000100:00100000:0.0:1788684106.877797:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788684106.877806:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085721216:12345-0@lo:41: 00000004:00000024:0.0:1788684106.877837:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788684106.877880:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085721216:12345-0@lo:41: Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684106.877887:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788684106.877971:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085721216:0@lo:41: 00000020:00000004:0.0:1788684107.092282:0:10065:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684107.092296:0:10065:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788684107.390539:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684107.485154:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684107.489598:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073089664 00000100:00100000:3.0:1788684107.489613:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073089664 00000100:00100000:3.0:1788684107.489720:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 179 00000100:00100000:3.0:1788684107.489728:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2389:x1875571073089664:12345-192.168.206.44@tcp:250: 00010000:00080000:3.0:1788684107.489822:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 922b1c50-9c41-4b31-aa18-fe2699f20279@192.168.206.44@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1788684107.489861:0:6489:0:(genops.c:1385:class_connect()) connect: client 922b1c50-9c41-4b31-aa18-fe2699f20279, cookie 0x44bac02bd54ac2dc 00000100:00080000:3.0:1788684107.490019:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8d677fa9e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684107.490085:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+5:2389:x1875571073089664:12345-192.168.206.44@tcp:250: Request processed in 356us (4940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684107.490094:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 179 00000100:00100000:2.0:1788684107.499393:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684107.500728:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073089792 00000100:00100000:3.0:1788684107.500743:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073089792 00000100:00100000:3.0:1788684107.500807:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 180 00000100:00100000:3.0:1788684107.500818:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+5:6147:x1875571073089792:12345-192.168.206.44@tcp:101: 00010000:00010000:3.0:1788684107.500834:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684107.500852:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed38f5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684107.500880:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38f5 expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684107.500893:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38f5 expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684107.500903:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67820ee000, rc 0) 00000100:00100000:3.0:1788684107.500964:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+6:6147:x1875571073089792:12345-192.168.206.44@tcp:101: Request processed in 148us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684107.500971:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 180 00000100:00100000:3.0:1788684107.506078:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684107.506395:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073089920 00000100:00100000:0.0:1788684107.506404:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073089920 00000100:00100000:0.0:1788684107.506456:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00100000:0.0:1788684107.506467:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+6:6147:x1875571073089920:12345-192.168.206.44@tcp:501: 00000100:00100000:0.0:1788684107.506571:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+6:6147:x1875571073089920:12345-192.168.206.44@tcp:501: Request processed in 106us (502us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788684107.506580:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00100000:3.0:1788684107.510621:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684107.510697:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073090048 00000100:00100000:2.0:1788684107.510707:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073090048 00000100:00100000:2.0:1788684107.510762:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:2.0:1788684107.510773:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+6:6147:x1875571073090048:12345-192.168.206.44@tcp:101: 00010000:00010000:2.0:1788684107.510788:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684107.510816:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed38fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684107.510846:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38fc expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684107.510856:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38fc expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684107.510866:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477ff200, rc 0) 00000100:00100000:2.0:1788684107.510920:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+7:6147:x1875571073090048:12345-192.168.206.44@tcp:101: Request processed in 150us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684107.510927:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:2.0:1788684107.512773:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684107.514076:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073090176 00000100:00100000:3.0:1788684107.514089:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073090176 00000100:00100000:3.0:1788684107.514152:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:3.0:1788684107.514162:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+7:6147:x1875571073090176:12345-192.168.206.44@tcp:501: 00000100:00100000:3.0:1788684107.515858:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+8:6147:x1875571073090176:12345-192.168.206.44@tcp:501: Request processed in 1689us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684107.515880:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:1.0:1788684107.520743:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684107.520826:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073090304 00000100:00100000:0.0:1788684107.520835:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073090304 00000100:00100000:0.0:1788684107.520885:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:0.0:1788684107.520894:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+8:6147:x1875571073090304:12345-192.168.206.44@tcp:503: 00000100:00100000:0.0:1788684107.521036:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+8:6147:x1875571073090304:12345-192.168.206.44@tcp:503: Request processed in 142us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684107.521044:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:2.0:1788684107.531188:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684107.531523:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073090432 00000100:00100000:0.0:1788684107.531532:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073090432 00000100:00100000:2.0:1788684107.531707:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 185 00000100:00100000:2.0:1788684107.531717:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+8:6165:x1875571073090432:12345-192.168.206.44@tcp:502: 00000100:00100000:2.0:1788684107.532595:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+8:6165:x1875571073090432:12345-192.168.206.44@tcp:502: Request processed in 865us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684107.532605:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 185 00000100:00100000:3.0:1788684107.556130:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684107.556240:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073090560 00000100:00100000:2.0:1788684107.556250:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073090560 00000100:00100000:2.0:1788684107.556449:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:2.0:1788684107.556458:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+8:6165:x1875571073090560:12345-192.168.206.44@tcp:502: 00000100:00100000:2.0:1788684107.556600:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+8:6165:x1875571073090560:12345-192.168.206.44@tcp:502: Request processed in 143us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684107.556609:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:1.0:1788684107.568691:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684107.568799:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073090688 00000100:00100000:2.0:1788684107.568808:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073090688 00000100:00100000:2.0:1788684107.568858:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:2.0:1788684107.568868:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+8:6147:x1875571073090688:12345-192.168.206.44@tcp:101: 00010000:00010000:2.0:1788684107.568884:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684107.568902:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477ff800/0x44bac02bd54ac2f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed392d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684107.568928:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477ff800/0x44bac02bd54ac2f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed392d expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684107.568939:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477ff800/0x44bac02bd54ac2f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed392d expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684107.568948:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477ff800, rc 0) 00000100:00100000:2.0:1788684107.569062:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6147:x1875571073090688:12345-192.168.206.44@tcp:101: Request processed in 195us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684107.569069:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:3.0:1788684107.584761:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684107.584862:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073090816 00000100:00100000:0.0:1788684107.584871:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073090816 00000100:00100000:0.0:1788684107.584929:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 188 00000100:00100000:0.0:1788684107.584940:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6147:x1875571073090816:12345-192.168.206.44@tcp:256: 20000000:01000000:0.0:1788684107.584963:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788684107.584988:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788684107.584992:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788684107.584994:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788684107.584997:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788684107.585000:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788684107.590215:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6147:x1875571073090816:12345-192.168.206.44@tcp:256: Request processed in 5266us (5451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684107.590228:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 188 00000100:00100000:1.0:1788684107.596879:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684107.596968:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073090944 00000100:00100000:3.0:1788684107.596978:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073090944 00000100:00100000:3.0:1788684107.597035:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 189 00000100:00100000:3.0:1788684107.597046:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6147:x1875571073090944:12345-192.168.206.44@tcp:101: 00010000:00010000:3.0:1788684107.597063:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684107.597078:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3934 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684107.597105:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3934 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684107.597117:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3934 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684107.597127:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67820ee400, rc 0) 00000100:00100000:3.0:1788684107.597187:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6147:x1875571073090944:12345-192.168.206.44@tcp:101: Request processed in 143us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684107.597195:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 189 00000100:00100000:3.0:1788684107.600897:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684107.601008:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073091072 00000100:00100000:0.0:1788684107.601020:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073091072 00000100:00100000:0.0:1788684107.601077:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 190 00000100:00100000:0.0:1788684107.601087:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6147:x1875571073091072:12345-192.168.206.44@tcp:501: 00000100:00100000:0.0:1788684107.601238:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6147:x1875571073091072:12345-192.168.206.44@tcp:501: Request processed in 152us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684107.601246:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 190 00000100:00100000:0.0:1788684107.605481:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684107.605689:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073091200 00000100:00100000:2.0:1788684107.605698:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073091200 00000100:00100000:2.0:1788684107.605748:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:2.0:1788684107.605757:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6147:x1875571073091200:12345-192.168.206.44@tcp:503: 00000100:00100000:2.0:1788684107.605941:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6147:x1875571073091200:12345-192.168.206.44@tcp:503: Request processed in 184us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684107.605950:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:1.0:1788684107.608168:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684107.617105:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073091328 00000100:00100000:0.0:1788684107.617120:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073091328 00000100:00100000:0.0:1788684107.617192:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:0.0:1788684107.617203:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6170:x1875571073091328:12345-192.168.206.44@tcp:502: 00000100:00100000:0.0:1788684107.617396:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6170:x1875571073091328:12345-192.168.206.44@tcp:502: Request processed in 194us (9234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684107.617404:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:0.0:1788684107.622547:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684107.622682:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073091456 00000100:00100000:2.0:1788684107.622691:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073091456 00000100:00100000:2.0:1788684107.622747:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:2.0:1788684107.622770:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6170:x1875571073091456:12345-192.168.206.44@tcp:502: 00000100:00100000:2.0:1788684107.622907:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6170:x1875571073091456:12345-192.168.206.44@tcp:502: Request processed in 138us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684107.622914:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:2.0:1788684107.629724:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684107.629824:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684107.635923:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073091584 00000100:00100000:0.0:1788684107.635936:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073091584 00000100:00100000:0.0:1788684107.635995:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073091840 00000100:00100000:0.0:1788684107.635999:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073091840 00000100:00100000:1.0:1788684107.636147:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:1.0:1788684107.636156:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2389:x1875571073091584:12345-192.168.206.44@tcp:38: 00010000:00080000:1.0:1788684107.636521:0:6497:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:1.0:1788684107.636568:0:6497:0:(genops.c:1385:class_connect()) connect: client 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e, cookie 0x44bac02bd54ac2ff 00000004:00100000:1.0:1788684107.636592:0:6497:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788684107.637531:0:6497:0:(import.c:65:import_set_state_nolock()) ffff8d6646d42000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684107.638136:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:0.0:1788684107.638144:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875571073091840:12345-192.168.206.44@tcp:38: 00010000:00080000:0.0:1788684107.638168:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:0.0:1788684107.638219:0:6498:0:(genops.c:1385:class_connect()) connect: client 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e, cookie 0x44bac02bd54ac306 00000004:00100000:0.0:1788684107.638247:0:6498:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788684107.638437:0:6498:0:(import.c:65:import_set_state_nolock()) ffff8d677e50a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684107.638475:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2389:x1875571073091840:12345-192.168.206.44@tcp:38: Request processed in 327us (8648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684107.638476:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2389:x1875571073091584:12345-192.168.206.44@tcp:38: Request processed in 2313us (8754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684107.638491:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:1.0:1788684107.638500:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00010000:00010000:0.0:1788684108.414362:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684108.654640:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684108.654772:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073091968 00000100:00100000:2.0:1788684108.654781:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073091968 00000100:00100000:2.0:1788684108.654856:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:2.0:1788684108.654867:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:0:x1875571073091968:12345-192.168.206.44@tcp:41: 00000004:00000024:2.0:1788684108.654918:0:7963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788684108.654996:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:0:x1875571073091968:12345-192.168.206.44@tcp:41: Request processed in 130us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684108.655003:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00080000:0.0:1788684108.655233:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684108.655455:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684108.655528:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073092096 00000100:00100000:2.0:1788684108.655533:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073092096 00000100:00100000:2.0:1788684108.655583:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:2.0:1788684108.655591:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6147:x1875571073092096:12345-192.168.206.44@tcp:41: 00000004:00000024:2.0:1788684108.655612:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788684108.655668:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6147:x1875571073092096:12345-192.168.206.44@tcp:41: Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684108.655675:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00080000:0.0:1788684108.655730:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684108.655926:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684108.656001:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073091712 00000100:00100000:3.0:1788684108.656279:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073091712 00000100:00100000:3.0:1788684108.656435:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:3.0:1788684108.656467:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:0:x1875571073091712:12345-192.168.206.44@tcp:41: 00000004:00000024:3.0:1788684108.656517:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788684108.656630:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:0:x1875571073091712:12345-192.168.206.44@tcp:41: Request processed in 183us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684108.656640:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:3.0:1788684108.662896:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684108.663198:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073092224 00000100:00100000:2.0:1788684108.663210:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073092224 00000100:00100000:2.0:1788684108.663286:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:2.0:1788684108.663298:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6147:x1875571073092224:12345-192.168.206.44@tcp:40: 00000100:00100000:2.0:1788684108.663482:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6147:x1875571073092224:12345-192.168.206.44@tcp:40: Request processed in 185us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684108.663491:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:0.0:1788684108.666458:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684108.666503:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684108.666547:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684108.666730:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073092352 00000100:00100000:1.0:1788684108.666739:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073092352 00000100:00100000:1.0:1788684108.666781:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073092480 00000100:00100000:1.0:1788684108.666784:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073092480 00000100:00100000:1.0:1788684108.666801:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:1.0:1788684108.666808:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875571073092352:12345-192.168.206.44@tcp:8: 00010000:00080000:1.0:1788684108.666839:0:9991:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1788684108.666889:0:9991:0:(genops.c:1385:class_connect()) connect: client 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e, cookie 0x44bac02bd54ac30d 00002000:00100000:1.0:1788684108.666901:0:9991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e/ffff8d677cefe800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788684108.666918:0:9991:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788684108.667145:0:9991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788684108.667172:0:9991:0:(import.c:65:import_set_state_nolock()) ffff8d664742a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684108.667237:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2389:x1875571073092352:12345-192.168.206.44@tcp:8: Request processed in 427us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684108.667245:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:1.0:1788684108.667265:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684108.667270:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875571073092480:12345-192.168.206.44@tcp:8: 00010000:00080000:1.0:1788684108.667287:0:9991:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1788684108.667307:0:9991:0:(genops.c:1385:class_connect()) connect: client 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e, cookie 0x44bac02bd54ac314 00002000:00100000:1.0:1788684108.667313:0:9991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e/ffff8d664742f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788684108.667336:0:9991:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788684108.667517:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684108.667653:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073092608 00000100:00100000:3.0:1788684108.667665:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073092608 00000100:00100000:2.0:1788684108.667746:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073092736 00000100:00100000:2.0:1788684108.667754:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073092736 00000100:00100000:2.0:1788684108.667803:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:2.0:1788684108.667812:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6147:x1875571073092736:12345-192.168.206.44@tcp:900: 00000100:00100000:2.0:1788684108.667862:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6147:x1875571073092736:12345-192.168.206.44@tcp:900: Request processed in 52us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684108.667869:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00002000:00080000:1.0:1788684108.667999:0:9991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788684108.668025:0:9991:0:(import.c:65:import_set_state_nolock()) ffff8d664742c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684108.668111:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2389:x1875571073092480:12345-192.168.206.44@tcp:8: Request processed in 838us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684108.668119:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1788684108.668438:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:3.0:1788684108.668456:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2392:x1875571073092608:12345-192.168.206.44@tcp:400: 00000100:00100000:3.0:1788684108.668538:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2392:x1875571073092608:12345-192.168.206.44@tcp:400: Request processed in 86us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684108.668547:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:0.0:1788684108.681409:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684108.681816:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073092864 00000100:00100000:2.0:1788684108.681830:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073092864 00000100:00100000:2.0:1788684108.682092:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:2.0:1788684108.682107:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6147:x1875571073092864:12345-192.168.206.44@tcp:33: 00000004:00080000:1.0:1788684108.709586:0:6500:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24123us 00000004:00200000:2.0:1788684108.728359:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788684108.728521:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6147:x1875571073092864:12345-192.168.206.44@tcp:33: Request processed in 46414us (47124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684108.728531:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:2.0:1788684108.973205:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684108.973266:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073092992 00000100:00100000:3.0:1788684108.973276:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073092992 00000100:00100000:3.0:1788684108.973477:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:3.0:1788684108.973493:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6189:x1875571073092992:12345-192.168.206.44@tcp:101: 00010000:00010000:3.0:1788684108.973514:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684108.973590:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67820efa00/0x44bac02bd54ac31b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3965 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684108.973674:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac322 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684108.973696:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684108.973708:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684108.973752:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788684108.973755:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684108.973768:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684108.973793:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67820efa00/0x44bac02bd54ac31b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3965 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684108.973809:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3965 expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684108.973817:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c600) 00010000:00010000:3.0:1788684108.973819:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788684108.973822:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711ca00, rc 0) 00000100:00100000:3.0:1788684108.973884:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:6189:x1875571073092992:12345-192.168.206.44@tcp:101: Request processed in 393us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684108.973891:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00010000:00010000:1.0:1788684109.437634:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684110.463349:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684110.978684:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085721344:0@lo:400: 00000100:00100000:3.0:1788684110.978755:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.978856:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085721984:0@lo:400: 00000100:00100000:3.0:1788684110.978883:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.978920:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085722496:0@lo:400: 00000100:00100000:3.0:1788684110.978944:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.978964:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085723008:0@lo:400: 00000100:00100000:3.0:1788684110.978984:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979004:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788684110.979011:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085721600:0@lo:400: 00000100:00100000:3.0:1788684110.979034:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979050:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085722112:0@lo:400: 00000100:00100000:3.0:1788684110.979071:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979088:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085722624:0@lo:400: 00000100:00100000:3.0:1788684110.979110:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979126:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085723136:0@lo:13: 00000100:00100000:3.0:1788684110.979147:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979171:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085721472:0@lo:13: 00000100:00100000:1.0:1788684110.979173:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085721600 00000100:00100000:1.0:1788684110.979181:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085721600 00000100:00100000:3.0:1788684110.979190:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979206:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085721856:0@lo:400: 00000100:00100000:1.0:1788684110.979221:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085722112 00000100:00100000:1.0:1788684110.979224:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085722112 00000100:00100000:3.0:1788684110.979267:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979282:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085722368:0@lo:400: 00000100:00100000:3.0:1788684110.979302:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979328:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085722880:0@lo:400: 00000100:00100000:1.0:1788684110.979335:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085722624 00000100:00100000:1.0:1788684110.979339:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085722624 00000100:00100000:3.0:1788684110.979347:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684110.979362:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085721856 00000100:00100000:3.0:1788684110.979380:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788684110.979382:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085721856 00000100:00100000:3.0:1788684110.979387:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085721728:0@lo:400: 00000100:00100000:1.0:1788684110.979399:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788684110.979407:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979424:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085722240:0@lo:400: 00000100:00100000:3.0:1788684110.979472:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979486:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085722752:0@lo:400: 00000100:00100000:3.0:1788684110.979506:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684110.979533:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085723136 00000100:00100000:3.0:1788684110.979536:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085723136 00000100:00100000:3.0:1788684110.979567:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085721472 00000100:00100000:3.0:1788684110.979570:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085721472 00000100:00100000:3.0:1788684110.979584:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788684110.979590:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085723136:12345-0@lo:13: 00002000:00000024:3.0:1788684110.979618:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684110.979660:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085723136:12345-0@lo:13: Request processed in 69us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.979666:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788684110.979683:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788684110.979689:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085721472:12345-0@lo:13: 00002000:00000024:3.0:1788684110.979698:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684110.979723:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085721472:12345-0@lo:13: Request processed in 35us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.979729:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788684110.979748:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085722496 00000100:00100000:3.0:1788684110.979751:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085722496 00000100:00100000:3.0:1788684110.979765:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085723008 00000100:00100000:3.0:1788684110.979768:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085723008 00000100:00100000:3.0:1788684110.979778:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085722368 00000100:00100000:3.0:1788684110.979780:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085722368 00000100:00100000:3.0:1788684110.979788:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085722880 00000100:00100000:3.0:1788684110.979790:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085722880 00000100:00100000:3.0:1788684110.979802:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684110.979807:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085722496:12345-0@lo:400: 00000100:00100000:3.0:1788684110.979843:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085722496:12345-0@lo:400: Request processed in 35us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.979850:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684110.979860:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684110.979866:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085723008:12345-0@lo:400: 00000100:00100000:3.0:1788684110.979890:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085723008:12345-0@lo:400: Request processed in 25us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.979896:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684110.979906:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684110.979911:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085722368:12345-0@lo:400: 00000100:00100000:3.0:1788684110.979936:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085722368:12345-0@lo:400: Request processed in 25us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.979942:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684110.979951:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684110.979957:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3626:x1875571085722880:12345-0@lo:400: 00000100:00100000:3.0:1788684110.979995:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3626:x1875571085722880:12345-0@lo:400: Request processed in 38us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.980001:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788684110.980034:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa81180 x1875571085723136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684110.980053:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085723136:0@lo:13: 00010000:00080000:3.0:1788684110.980064:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d33800 x1875571085722496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684110.980073:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085722496:0@lo:400: 00010000:00080000:3.0:1788684110.980082:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d30000 x1875571085723008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684110.980097:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085723008:0@lo:400: 00000100:00100000:1.0:1788684110.980127:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085721600:12345-0@lo:400: 00010000:00080000:3.0:1788684110.980135:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa72a00 x1875571085721472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684110.980147:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085721472:0@lo:13: 00010000:00080000:3.0:1788684110.980156:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d33100 x1875571085722368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684110.980164:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085722368:0@lo:400: 00000100:00100000:1.0:1788684110.980166:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085721600:12345-0@lo:400: Request processed in 42us (1131us total) trans 0 rc 0/0 00010000:00080000:3.0:1788684110.980171:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d32d80 x1875571085722880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684110.980172:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788684110.980179:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085722880:0@lo:400: 00000100:00100000:1.0:1788684110.980183:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085722240 00000100:00100000:1.0:1788684110.980185:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085722240 00000100:00100000:1.0:1788684110.980198:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085722752 00000100:00100000:1.0:1788684110.980200:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085722752 00000100:00100000:3.0:1788684110.980205:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085721600:0@lo:400: 00000100:00100000:1.0:1788684110.980213:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788684110.980218:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085722112:12345-0@lo:400: 00000100:00100000:3.0:1788684110.980224:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788684110.980231:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085722624:12345-0@lo:400: 00000100:00100000:3.0:1788684110.980261:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085722624:12345-0@lo:400: Request processed in 30us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.980267:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788684110.980289:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085722624:0@lo:400: 00000100:00100000:3.0:1788684110.980323:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788684110.980332:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085721856:12345-0@lo:400: 00000100:00100000:1.0:1788684110.980341:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085722112:12345-0@lo:400: Request processed in 122us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.980349:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085722112:0@lo:400: 00000100:00100000:1.0:1788684110.980356:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788684110.980387:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788684110.980399:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085722240:12345-0@lo:400: 00000100:00100000:3.0:1788684110.980403:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085721856:12345-0@lo:400: Request processed in 75us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.980414:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788684110.980441:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085721856:0@lo:400: 00000100:00100000:3.0:1788684110.980458:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788684110.980464:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085722752:12345-0@lo:400: 00000100:00100000:3.0:1788684110.980494:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085722752:12345-0@lo:400: Request processed in 31us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.980500:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788684110.980519:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d31500 x1875571085722752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684110.980528:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085722752:0@lo:400: 00000100:00100000:3.0:1788684110.980564:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085721984 00000100:00100000:3.0:1788684110.980568:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085721984 00000100:00100000:3.0:1788684110.980591:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085721728 00000100:00100000:3.0:1788684110.980594:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085721728 00000100:00100000:3.0:1788684110.980604:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788684110.980610:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085721984:12345-0@lo:400: 00000100:00100000:3.0:1788684110.980644:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085721984:12345-0@lo:400: Request processed in 34us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.980650:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788684110.980661:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788684110.980667:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085721728:12345-0@lo:400: 00000100:00100000:3.0:1788684110.980697:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085721728:12345-0@lo:400: Request processed in 29us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684110.980697:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085722240:12345-0@lo:400: Request processed in 298us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684110.980702:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788684110.980703:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788684110.980728:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085721984:0@lo:400: 00000100:00080000:1.0:1788684110.980734:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684110.980738:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788684110.980740:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788684110.980742:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684110.980753:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085721728:0@lo:400: 00010000:00080000:3.0:1788684110.980762:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d30e00 x1875571085722240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684110.980770:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085722240:0@lo:400: 00000100:00100000:0.0:1788684110.981314:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085721344 00000100:00100000:0.0:1788684110.981321:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085721344 00000100:00100000:0.0:1788684110.981413:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788684110.981423:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085721344:12345-0@lo:400: 00000100:00100000:0.0:1788684110.981567:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085721344:12345-0@lo:400: Request processed in 146us (2811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684110.981574:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788684110.981648:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085721344:0@lo:400: 00000100:00100000:2.0:1788684111.215070:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684111.215482:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073093120 00000100:00100000:3.0:1788684111.215492:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073093120 00000100:00100000:3.0:1788684111.215574:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:3.0:1788684111.215585:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:6241:x1875571073093120:12345-192.168.206.44@tcp:41: 00000004:00000024:3.0:1788684111.215617:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788684111.215682:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:6241:x1875571073093120:12345-192.168.206.44@tcp:41: Request processed in 99us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684111.215689:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00080000:1.0:1788684111.216030:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684111.229286:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684111.230577:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073093248 00000100:00100000:2.0:1788684111.230589:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073093248 00000100:00100000:2.0:1788684111.230673:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:2.0:1788684111.230684:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6241:x1875571073093248:12345-192.168.206.44@tcp:41: 00000004:00000024:2.0:1788684111.230719:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788684111.230785:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6241:x1875571073093248:12345-192.168.206.44@tcp:41: Request processed in 103us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684111.230804:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00080000:1.0:1788684111.230930:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684111.241146:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684111.241260:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073093376 00000100:00100000:3.0:1788684111.241272:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073093376 00000100:00100000:3.0:1788684111.241397:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:3.0:1788684111.241410:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6241:x1875571073093376:12345-192.168.206.44@tcp:13: 00002000:00000024:3.0:1788684111.241435:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788684111.241634:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684111.247411:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6241:x1875571073093376:12345-192.168.206.44@tcp:13: Request processed in 5992us (6262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684111.247425:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:3.0:1788684111.254470:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684111.258298:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073093504 00000100:00100000:0.0:1788684111.258319:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073093504 00000100:00100000:0.0:1788684111.258461:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:0.0:1788684111.258471:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6241:x1875571073093504:12345-192.168.206.44@tcp:13: 00002000:00000024:0.0:1788684111.258499:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684111.258571:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:6241:x1875571073093504:12345-192.168.206.44@tcp:13: Request processed in 101us (4109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684111.258589:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00080000:1.0:1788684111.265319:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684111.485708:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085723264:0@lo:13: 00000100:00100000:3.0:1788684111.485778:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684111.485928:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085723264 00000100:00100000:2.0:1788684111.485936:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085723264 00000100:00100000:2.0:1788684111.485987:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684111.485996:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085723264:12345-0@lo:13: 00002000:00000024:2.0:1788684111.486016:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684111.486060:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085723264:12345-0@lo:13: Request processed in 66us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684111.486067:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788684111.486145:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa72d80 x1875571085723264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684111.486164:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085723264:0@lo:13: 00010000:00010000:1.0:1788684111.486397:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684111.486703:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684111.486714:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085723520:0@lo:13: 00000100:00100000:3.0:1788684111.486743:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684111.486770:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085723520 00000100:00100000:3.0:1788684111.486773:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085723520 00000100:00100000:3.0:1788684111.486799:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788684111.486806:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085723520:12345-0@lo:13: 00002000:00000024:3.0:1788684111.486818:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684111.486847:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085723520:12345-0@lo:13: Request processed in 42us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684111.486853:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788684111.486879:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677718e680 x1875571085723520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684111.486893:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085723520:0@lo:13: 00000100:00100000:2.0:1788684111.487104:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684111.487113:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085723392:0@lo:41: 00000100:00100000:2.0:1788684111.487144:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684111.487297:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085723392 00000100:00100000:3.0:1788684111.487301:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085723392 00000100:00100000:3.0:1788684111.487348:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788684111.487356:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085723392:12345-0@lo:41: 00000004:00000024:3.0:1788684111.487390:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788684111.487437:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085723392:12345-0@lo:41: Request processed in 82us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684111.487444:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788684111.487557:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085723392:0@lo:41: 00000100:00100000:3.0:1788684111.999909:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085723648:0@lo:41: 00000100:00100000:3.0:1788684111.999984:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684112.000092:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085723648 00000100:00100000:2.0:1788684112.000099:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085723648 00000100:00100000:2.0:1788684112.000150:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788684112.000159:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085723648:12345-0@lo:41: 00000004:00000024:2.0:1788684112.000313:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788684112.000387:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085723648:12345-0@lo:41: Request processed in 229us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684112.000393:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788684112.000438:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085723648:0@lo:41: 00000001:00100000:3.0:1788684112.004900:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000001:00080000:3.0:1788684112.004915:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1788684112.004925:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788684112.511260:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788684113.026646:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000001:00100000:2.0:1788684113.026760:0:6476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00010000:00010000:0.0:1788684113.540605:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788684113.844847:0:10163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788684114.048722:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000100:00100000:0.0:1788684114.117119:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684114.117159:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684114.117330:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073093632 00000100:00100000:3.0:1788684114.117339:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073093632 00000100:00100000:3.0:1788684114.117434:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:3.0:1788684114.117445:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073093632:12345-192.168.206.44@tcp:400: 00000100:00100000:3.0:1788684114.117529:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073093632:12345-192.168.206.44@tcp:400: Request processed in 85us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684114.117536:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:1.0:1788684114.117895:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073093760 00000100:00100000:1.0:1788684114.117901:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073093760 00000100:00100000:1.0:1788684114.117972:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:1.0:1788684114.117980:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2391:x1875571073093760:12345-192.168.206.44@tcp:400: 00000100:00100000:1.0:1788684114.118024:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2391:x1875571073093760:12345-192.168.206.44@tcp:400: Request processed in 45us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684114.118031:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:0.0:1788684114.118409:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684114.118442:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684114.118471:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684114.118491:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073094016 00000100:00100000:0.0:1788684114.118495:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073094016 00000100:00100000:0.0:1788684114.118523:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073094144 00000100:00100000:0.0:1788684114.118536:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073094144 00000100:00100000:0.0:1788684114.118558:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:0.0:1788684114.118564:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073094016:12345-192.168.206.44@tcp:400: 00000100:00100000:0.0:1788684114.118601:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073094016:12345-192.168.206.44@tcp:400: Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684114.118609:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:1.0:1788684114.118620:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:1.0:1788684114.118631:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073094144:12345-192.168.206.44@tcp:400: 00000100:00100000:1.0:1788684114.118662:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073094144:12345-192.168.206.44@tcp:400: Request processed in 34us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684114.118669:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:2.0:1788684114.118698:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073093888 00000100:00100000:2.0:1788684114.118703:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073093888 00000100:00100000:2.0:1788684114.118754:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:2.0:1788684114.118774:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073093888:12345-192.168.206.44@tcp:400: 00000100:00100000:2.0:1788684114.118803:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073093888:12345-192.168.206.44@tcp:400: Request processed in 32us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684114.118809:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00080000:3.0:1788684114.119893:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684114.119910:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684114.119913:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684114.119915:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788684114.557818:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684115.584878:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684116.096349:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085723776:0@lo:400: 00000100:00100000:1.0:1788684116.096451:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.096510:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085724288:0@lo:400: 00000100:00100000:1.0:1788684116.096536:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.096556:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085724800:0@lo:400: 00000100:00100000:1.0:1788684116.096591:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.096614:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085725312:0@lo:400: 00000100:00100000:1.0:1788684116.096640:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.096662:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788684116.096668:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085723904:0@lo:400: 00000100:00100000:1.0:1788684116.096693:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.096711:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085724416:0@lo:400: 00000100:00100000:1.0:1788684116.096732:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.096751:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085724928:0@lo:400: 00000100:00100000:1.0:1788684116.096774:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.096808:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085724032:0@lo:400: 00000100:00100000:1.0:1788684116.096834:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.096853:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085724544:0@lo:400: 00000100:00100000:1.0:1788684116.096871:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.097034:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085725056:0@lo:400: 00000100:00100000:1.0:1788684116.097070:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.097085:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788684116.097091:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085724160:0@lo:400: 00000100:00100000:1.0:1788684116.097112:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.097123:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085724672:0@lo:400: 00000100:00100000:1.0:1788684116.097154:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.097174:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085725184:0@lo:400: 00000100:00100000:1.0:1788684116.097193:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.097227:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085723776 00000100:00100000:1.0:1788684116.097233:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085723776 00000100:00100000:1.0:1788684116.097274:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788684116.097296:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085723776:12345-0@lo:400: 00000100:00100000:1.0:1788684116.097342:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085723776:12345-0@lo:400: Request processed in 61us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.097348:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788684116.097404:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085724288 00000100:00100000:1.0:1788684116.097408:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085724288 00000100:00100000:1.0:1788684116.097433:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085724032 00000100:00100000:1.0:1788684116.097436:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085724032 00000100:00100000:1.0:1788684116.097447:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788684116.097453:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085724288:12345-0@lo:400: 00000100:00100000:1.0:1788684116.097485:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085724288:12345-0@lo:400: Request processed in 32us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.097491:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788684116.097501:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788684116.097506:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085724032:12345-0@lo:400: 00000100:00100000:1.0:1788684116.097536:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085724032:12345-0@lo:400: Request processed in 29us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.097542:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788684116.097557:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085724800 00000100:00100000:1.0:1788684116.097561:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085724800 00000100:00100000:1.0:1788684116.097588:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085725312 00000100:00100000:1.0:1788684116.097597:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085725312 00000100:00100000:1.0:1788684116.097611:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085724672 00000100:00100000:1.0:1788684116.097613:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085724672 00000100:00100000:1.0:1788684116.097625:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085725184 00000100:00100000:1.0:1788684116.097627:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085725184 00000100:00100000:1.0:1788684116.097639:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684116.097644:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085724800:12345-0@lo:400: 00000100:00100000:1.0:1788684116.097672:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085724800:12345-0@lo:400: Request processed in 28us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.097678:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684116.097687:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684116.097693:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085725312:12345-0@lo:400: 00000100:00100000:1.0:1788684116.097718:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085725312:12345-0@lo:400: Request processed in 25us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.097723:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684116.097732:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684116.097737:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085724672:12345-0@lo:400: 00000100:00100000:1.0:1788684116.097759:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085724672:12345-0@lo:400: Request processed in 22us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.097764:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684116.097773:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788684116.097778:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085725184:12345-0@lo:400: 00000100:00100000:1.0:1788684116.097798:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085725184:12345-0@lo:400: Request processed in 20us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.097803:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788684116.097823:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085723904 00000100:00100000:1.0:1788684116.097826:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085723904 00000100:00100000:1.0:1788684116.097842:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085724416 00000100:00100000:1.0:1788684116.097850:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085724416 00000100:00100000:1.0:1788684116.097864:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085724928 00000100:00100000:1.0:1788684116.097866:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085724928 00000100:00100000:1.0:1788684116.097876:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085724544 00000100:00100000:1.0:1788684116.097879:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085724544 00000100:00100000:1.0:1788684116.097888:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085725056 00000100:00100000:1.0:1788684116.097890:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085725056 00000100:00100000:1.0:1788684116.097899:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085724160 00000100:00100000:1.0:1788684116.097901:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085724160 00000100:00100000:1.0:1788684116.097912:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788684116.097917:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085723904:12345-0@lo:400: 00000100:00100000:1.0:1788684116.097950:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085723904:12345-0@lo:400: Request processed in 32us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.097956:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788684116.097967:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788684116.097973:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085724416:12345-0@lo:400: 00000100:00100000:1.0:1788684116.097999:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085724416:12345-0@lo:400: Request processed in 27us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.098005:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788684116.098016:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788684116.098022:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085724928:12345-0@lo:400: 00000100:00100000:1.0:1788684116.098047:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085724928:12345-0@lo:400: Request processed in 26us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.098053:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788684116.098064:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788684116.098069:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085724544:12345-0@lo:400: 00000100:00100000:1.0:1788684116.098096:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085724544:12345-0@lo:400: Request processed in 27us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.098111:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788684116.098123:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788684116.098129:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085725056:12345-0@lo:400: 00000100:00100000:1.0:1788684116.098158:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085725056:12345-0@lo:400: Request processed in 29us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.098163:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788684116.098174:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684116.098180:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085724160:12345-0@lo:400: 00000100:00100000:1.0:1788684116.098205:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085724160:12345-0@lo:400: Request processed in 26us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.098210:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788684116.102578:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684116.102602:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085725568:0@lo:13: 00000100:00100000:2.0:1788684116.102662:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684116.102707:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085725568 00000100:00100000:2.0:1788684116.102713:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085725568 00000100:00100000:2.0:1788684116.102754:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684116.102762:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085725568:12345-0@lo:13: 00002000:00000024:2.0:1788684116.102789:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684116.102992:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085725568:12345-0@lo:13: Request processed in 228us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684116.103125:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788684116.103291:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa70700 x1875571085725568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684116.103312:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085725568:0@lo:13: 00000100:00100000:0.0:1788684116.108005:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085723904:0@lo:400: 00000100:00100000:0.0:1788684116.108023:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085724416:0@lo:400: 00000100:00100000:0.0:1788684116.108035:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085724928:0@lo:400: 00000100:00100000:0.0:1788684116.108045:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085723776:0@lo:400: 00000100:00100000:0.0:1788684116.108055:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085724288:0@lo:400: 00010000:00080000:0.0:1788684116.108069:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d32300 x1875571085724800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684116.108092:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085724800:0@lo:400: 00010000:00080000:0.0:1788684116.108107:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d30000 x1875571085725312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684116.108114:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788684116.108130:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085725312:0@lo:400: 00000100:00100000:0.0:1788684116.108156:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684116.108166:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085725440:0@lo:13: 00000100:00100000:0.0:1788684116.108222:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684116.108266:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085725440 00000100:00100000:0.0:1788684116.108272:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085725440 00000100:00100000:0.0:1788684116.108324:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788684116.108332:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085725440:12345-0@lo:13: 00002000:00000024:0.0:1788684116.108382:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684116.108426:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085725440:12345-0@lo:13: Request processed in 94us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684116.108432:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788684116.108463:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6775ef5500 x1875571085725440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684116.108478:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085725440:0@lo:13: 00000100:00080000:1.0:1788684116.108611:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684116.108617:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684116.109903:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788684116.109984:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684116.110120:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085724160:0@lo:400: 00010000:00080000:1.0:1788684116.110136:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d32680 x1875571085724672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684116.110217:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085724672:0@lo:400: 00010000:00080000:1.0:1788684116.110231:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d33100 x1875571085725184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684116.110239:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788684116.110252:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085725184:0@lo:400: 00000100:00100000:1.0:1788684116.110264:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085724032:0@lo:400: 00010000:00080000:1.0:1788684116.110299:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d33b80 x1875571085724544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684116.110307:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085724544:0@lo:400: 00010000:00080000:1.0:1788684116.110318:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d32d80 x1875571085725056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684116.110325:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085725056:0@lo:400: 00010000:00010000:3.0:1788684116.606957:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684116.607241:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085725696:0@lo:13: 00000100:00100000:0.0:1788684116.607310:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684116.607389:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085725696 00000100:00100000:0.0:1788684116.607396:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085725696 00000100:00100000:0.0:1788684116.607432:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788684116.607439:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085725696:12345-0@lo:13: 00002000:00000024:0.0:1788684116.607476:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684116.607513:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085725696:12345-0@lo:13: Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684116.607519:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788684116.607567:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677718f100 x1875571085725696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684116.607582:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085725696:0@lo:13: 00000100:00100000:2.0:1788684116.608447:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684116.608458:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085725824:0@lo:13: 00000100:00100000:2.0:1788684116.608490:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684116.608522:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085725824 00000100:00100000:2.0:1788684116.608526:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085725824 00000100:00100000:2.0:1788684116.608561:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788684116.608567:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085725824:12345-0@lo:13: 00002000:00000024:2.0:1788684116.608588:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684116.608617:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085725824:12345-0@lo:13: Request processed in 50us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684116.608623:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788684116.608649:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa70700 x1875571085725824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684116.608661:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085725824:0@lo:13: 00000100:00100000:2.0:1788684116.609738:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085725952:0@lo:41: 00000100:00100000:2.0:1788684116.609780:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684116.609934:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085725952 00000100:00100000:1.0:1788684116.609940:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085725952 00000100:00100000:1.0:1788684116.609985:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788684116.609993:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085725952:12345-0@lo:41: 00000004:00000024:1.0:1788684116.610029:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684116.610080:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085725952:12345-0@lo:41: Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684116.610087:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788684116.610206:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085725952:0@lo:41: 00000100:00100000:0.0:1788684117.124786:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684117.124809:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085726080:0@lo:41: 00000100:00100000:0.0:1788684117.124873:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684117.124932:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085726080 00000100:00100000:0.0:1788684117.124939:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085726080 00000100:00100000:0.0:1788684117.124979:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788684117.124986:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085726080:12345-0@lo:41: 00000004:00000024:0.0:1788684117.125026:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788684117.125068:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085726080:12345-0@lo:41: Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684117.125075:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788684117.125118:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085726080:0@lo:41: 00000020:00000080:2.0:1788684117.454099:0:10311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0c9a7a80 20000000:00000080:2.0:1788684117.454121:0:10311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d6777220c00 uarg=0000000000000000 20000000:01000000:2.0:1788684117.454250:0:10311:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788684117.454254:0:10311:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788684117.454257:0:10311:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788684117.454262:0:10311:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788684117.454269:0:10311:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788684117.454354:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788684117.454357:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788684117.454990:0:10312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788684117.455497:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788684117.455626:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788684117.455648:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788684117.455665:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788684117.455668:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788684117.456263:0:10313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788684117.456740:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788684117.456772:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788684117.456790:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1788684117.456802:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788684117.456811:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788684117.457238:0:10314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788684117.457635:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788684117.457658:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788684117.457676:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1788684117.457688:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788684117.457690:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788684117.458080:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788684117.458285:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788684117.458308:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788684117.458327:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1788684117.458338:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788684117.458340:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788684117.459748:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788684117.460090:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788684117.460120:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788684117.460135:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1788684117.460225:0:10311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788684117.460251:0:10311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460285:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac1bd expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460294:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac1e7 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460301:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac226 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460308:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac234 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460314:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac242 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460338:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac25e expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460346:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac288 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460352:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac2a4 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460360:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac2ce expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460484:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38f5 expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460492:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38fc expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460502:0:10311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460555:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38fc expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460574:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38fc expref: 9 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.460592:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726208:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684117.460772:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38f5 expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460789:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38f5 expref: 9 pid: 6490 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.460798:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726336:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684117.460852:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac2ce expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.460860:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac2ce expref: 23 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.460870:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726464:0@lo:104: 00000100:00100000:0.0:1788684117.460995:0:10311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684117.461080:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac2a4 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.461090:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac2a4 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.461099:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726592:0@lo:104: 00000100:00100000:0.0:1788684117.461121:0:10311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684117.461758:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac288 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.461769:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac288 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.461780:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726720:0@lo:104: 00000100:00100000:0.0:1788684117.461809:0:10311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684117.461843:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085726464 00000100:00100000:2.0:1788684117.461852:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085726464 00000100:00100000:3.0:1788684117.461924:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085726592 00000100:00100000:3.0:1788684117.461929:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085726592 00000100:00100000:3.0:1788684117.462012:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788684117.462024:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:10311:x1875571085726464:12345-0@lo:104: 00010000:00010000:3.0:1788684117.462041:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462107:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788684117.462114:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:10311:x1875571085726464:12345-0@lo:104: Request processed in 93us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684117.462121:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788684117.462154:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788684117.462161:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:10311:x1875571085726592:12345-0@lo:104: 00010000:00010000:3.0:1788684117.462171:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462204:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788684117.462209:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:10311:x1875571085726592:12345-0@lo:104: Request processed in 50us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684117.462215:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788684117.462235:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684117.462241:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462248:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a7000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684117.462253:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462262:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684117.462270:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684117.462287:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684117.462329:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462335:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684117.462355:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462363:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a7000/0x44bac02bd54ac2ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac2d5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462396:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684117.462399:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462405:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a7c00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684117.462409:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462415:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684117.462421:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684117.462426:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684117.462439:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462445:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684117.462460:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462478:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a7c00/0x44bac02bd54ac2a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac2ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.462487:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684117.462489:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684117.462490:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684117.462516:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085726848:0@lo:103: 00000100:00100000:3.0:1788684117.462552:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684117.462594:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085726976:0@lo:103: 00000100:00100000:3.0:1788684117.462619:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684117.462814:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684117.462954:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac25e expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.462966:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac25e expref: 23 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.462978:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727104:0@lo:104: 00000100:00100000:0.0:1788684117.463004:0:10311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684117.463068:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac242 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.463076:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac242 expref: 23 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.463084:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727232:0@lo:104: 00010000:00010000:0.0:1788684117.463109:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac234 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.463117:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac234 expref: 23 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.463125:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727360:0@lo:104: 00010000:00010000:0.0:1788684117.463160:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac226 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.463169:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac226 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.463177:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727488:0@lo:104: 00010000:00010000:0.0:1788684117.463201:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac1e7 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.463217:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac1e7 expref: 23 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.463225:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727616:0@lo:104: 00010000:00010000:0.0:1788684117.463267:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac1bd expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.463286:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac1bd expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.463296:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727744:0@lo:104: 00000100:00100000:0.0:1788684117.463318:0:10311:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684117.463342:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726464:0@lo:104: 00000100:00100000:0.0:1788684117.463352:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726592:0@lo:104: 00000100:00100000:3.0:1788684117.463542:0:9498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788684117.463562:0:9498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684117.463574:0:9498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684117.463583:0:9498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684117.463590:0:9498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684117.463599:0:9498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684117.463606:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085726720 00000100:00100000:3.0:1788684117.463612:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085726720 00000100:00100000:3.0:1788684117.463640:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085727104 00000100:00100000:3.0:1788684117.463643:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085727104 00000100:00100000:3.0:1788684117.463654:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085727232 00000100:00100000:3.0:1788684117.463656:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085727232 00000100:00100000:3.0:1788684117.463665:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085727360 00000100:00100000:3.0:1788684117.463667:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085727360 00000100:00100000:3.0:1788684117.463676:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085727488 00000100:00100000:3.0:1788684117.463678:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085727488 00000100:00100000:3.0:1788684117.463686:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085727616 00000100:00100000:3.0:1788684117.463688:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085727616 00000100:00100000:3.0:1788684117.463697:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085727744 00000100:00100000:3.0:1788684117.463706:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085727744 00000100:00100000:3.0:1788684117.463723:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788684117.463731:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:10311:x1875571085726720:12345-0@lo:104: 00010000:00010000:3.0:1788684117.463742:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.463801:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788684117.463807:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+9:10311:x1875571085726720:12345-0@lo:104: Request processed in 77us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684117.463813:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788684117.463830:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788684117.463836:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+8:10311:x1875571085727104:12345-0@lo:104: 00010000:00010000:3.0:1788684117.463844:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.463876:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788684117.463881:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+8:10311:x1875571085727104:12345-0@lo:104: Request processed in 46us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684117.464179:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788684117.464214:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788684117.464221:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+7:10311:x1875571085727232:12345-0@lo:104: 00010000:00010000:3.0:1788684117.464231:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464267:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788684117.464284:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+7:10311:x1875571085727232:12345-0@lo:104: Request processed in 53us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684117.464290:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788684117.464311:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788684117.464317:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:10311:x1875571085727360:12345-0@lo:104: 00010000:00010000:3.0:1788684117.464325:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464353:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788684117.464357:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:10311:x1875571085727360:12345-0@lo:104: Request processed in 42us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684117.464386:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788684117.464399:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684117.464406:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:10311:x1875571085727488:12345-0@lo:104: 00010000:00010000:3.0:1788684117.464413:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464440:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788684117.464445:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:10311:x1875571085727488:12345-0@lo:104: Request processed in 41us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684117.464451:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684117.464464:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684117.464470:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:10311:x1875571085727616:12345-0@lo:104: 00010000:00010000:3.0:1788684117.464478:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464504:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788684117.464509:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:10311:x1875571085727616:12345-0@lo:104: Request processed in 40us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684117.464515:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684117.464533:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788684117.464539:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:10311:x1875571085727744:12345-0@lo:104: 00010000:00010000:3.0:1788684117.464547:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464576:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788684117.464580:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:10311:x1875571085727744:12345-0@lo:104: Request processed in 42us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684117.464587:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788684117.464606:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788684117.464612:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464621:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67820ee800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684117.464625:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464634:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684117.464642:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684117.464648:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684117.464681:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464688:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684117.464706:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464725:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67820ee800/0x44bac02bd54ac288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac28f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464740:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788684117.464743:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464749:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a6e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684117.464752:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464759:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684117.464766:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684117.464771:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684117.464785:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464792:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684117.464805:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464812:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a6e00/0x44bac02bd54ac25e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac265 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464824:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788684117.464833:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464840:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d674148a200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684117.464843:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.464850:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684117.464857:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684117.464862:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684117.464877:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684117.465153:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085726848 00000100:00100000:2.0:1788684117.465162:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085726848 00010000:00010000:2.0:1788684117.465191:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac2ce expref: 24 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684117.465213:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085726976 00000100:00100000:2.0:1788684117.465217:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085726976 00010000:00010000:2.0:1788684117.465239:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac2a4 expref: 25 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684117.465260:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684117.465266:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+25:3624:x1875571085726848:12345-0@lo:103: 00010000:00010000:2.0:1788684117.465287:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684117.465294:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac2ce expref: 25 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.465305:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac2ce expref: 25 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.465322:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67820ef800/0x44bac02bd54ac2d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac2ce expref: 25 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.465337:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684117.465399:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085726848:12345-0@lo:103: Request processed in 133us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684117.465406:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684117.465454:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788684117.465460:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3625:x1875571085726976:12345-0@lo:103: 00010000:00010000:2.0:1788684117.465468:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684117.465472:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac2a4 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.465481:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac2a4 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.465490:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a6200/0x44bac02bd54ac2ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac2a4 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.465511:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684117.465536:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3625:x1875571085726976:12345-0@lo:103: Request processed in 76us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684117.465542:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788684117.465659:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684117.465669:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465676:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d674148a200/0x44bac02bd54ac242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac249 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465689:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788684117.465693:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465699:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d674148a400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684117.465702:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465721:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684117.465728:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684117.465734:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684117.465752:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465758:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684117.465764:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465771:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d674148a400/0x44bac02bd54ac234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac23b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465780:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788684117.465784:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465789:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d674148bc00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684117.465791:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465798:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684117.465804:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684117.465815:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684117.465830:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465836:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684117.465840:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465845:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d674148bc00/0x44bac02bd54ac226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac22d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465858:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684117.465862:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465867:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a7e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684117.465870:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465877:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684117.465951:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684117.465958:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684117.465972:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465978:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684117.465990:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.465995:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a7e00/0x44bac02bd54ac1e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac1ee expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.466006:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684117.466010:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.466015:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030600 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684117.466018:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.466024:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684117.466030:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684117.466035:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684117.466067:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.466073:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684117.466079:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.466085:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac1bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac1c4 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684117.466099:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684117.466107:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684117.466109:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684117.466130:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085727872:0@lo:103: 00000100:00100000:0.0:1788684117.466317:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726720:0@lo:104: 00000100:00100000:0.0:1788684117.466330:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727104:0@lo:104: 00000100:00100000:0.0:1788684117.466340:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727232:0@lo:104: 00000100:00100000:0.0:1788684117.466349:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727360:0@lo:104: 00000100:00100000:0.0:1788684117.466359:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727488:0@lo:104: 00000100:00100000:0.0:1788684117.466388:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727616:0@lo:104: 00000100:00100000:0.0:1788684117.466399:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085727744:0@lo:104: 00000100:00100000:3.0:1788684117.466505:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684117.466654:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085728384:0@lo:103: 00000100:00100000:3.0:1788684117.466678:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684117.466728:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684117.467133:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684117.467152:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085728256:0@lo:103: 00000100:00100000:3.0:1788684117.467180:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684117.467383:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085727872 00000100:00100000:0.0:1788684117.467391:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085727872 00010000:00010000:0.0:1788684117.467429:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac288 expref: 22 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684117.467525:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085728384 00000100:00100000:2.0:1788684117.467530:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085728384 00010000:00010000:2.0:1788684117.467549:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac226 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684117.467574:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684117.467582:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3626:x1875571085727872:12345-0@lo:103: 00010000:00010000:2.0:1788684117.467595:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684117.467601:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac288 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.467611:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac288 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.467628:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148b200/0x44bac02bd54ac28f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac288 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.467650:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684117.467687:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3626:x1875571085727872:12345-0@lo:103: Request processed in 105us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684117.467694:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684117.467714:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684117.467721:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3626:x1875571085728384:12345-0@lo:103: 00010000:00010000:2.0:1788684117.467728:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684117.467739:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac226 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.467748:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac226 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.467757:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a6400/0x44bac02bd54ac22d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac226 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.467768:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684117.467793:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:3626:x1875571085728384:12345-0@lo:103: Request processed in 73us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684117.467799:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684117.467965:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085728256 00000100:00100000:2.0:1788684117.467969:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085728256 00010000:00010000:2.0:1788684117.467982:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac234 expref: 20 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684117.468000:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684117.468005:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:3626:x1875571085728256:12345-0@lo:103: 00010000:00010000:2.0:1788684117.468011:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684117.468015:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac234 expref: 20 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.468023:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac234 expref: 20 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.468032:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030400/0x44bac02bd54ac23b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac234 expref: 20 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.468040:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684117.468099:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085727872:0@lo:103: 00000100:00100000:3.0:1788684117.468108:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085728384:0@lo:103: 00000100:00100000:3.0:1788684117.468157:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085728000:0@lo:103: 00000100:00100000:1.0:1788684117.468226:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684117.468312:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073094272 00000100:00100000:0.0:1788684117.468317:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073094272 00010000:00010000:0.0:1788684117.468334:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38fc expref: 10 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.468347:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:0.0:1788684117.468353:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073094272:12345-192.168.206.44@tcp:103: 00010000:00010000:0.0:1788684117.468362:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684117.468383:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38fc expref: 10 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.468394:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38fc expref: 10 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.468404:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684117.468508:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:3626:x1875571085728256:12345-0@lo:103: Request processed in 502us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684117.468514:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684117.468544:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085728256:0@lo:103: 00000100:00100000:3.0:1788684117.468699:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684117.468760:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085728512:0@lo:103: 00000100:00100000:3.0:1788684117.468787:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684117.468909:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684117.469222:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073094272:12345-192.168.206.44@tcp:103: Request processed in 867us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684117.469230:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:3.0:1788684117.469462:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788684117.469471:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085728128:0@lo:103: 00000100:00100000:1.0:1788684117.469722:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085728000 00000100:00100000:1.0:1788684117.469729:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085728000 00010000:00010000:1.0:1788684117.469759:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac25e expref: 19 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684117.469779:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085728512 00000100:00100000:1.0:1788684117.469782:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085728512 00010000:00010000:1.0:1788684117.469793:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac1e7 expref: 20 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684117.469818:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073094400 00000100:00100000:1.0:1788684117.469821:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073094400 00010000:00010000:1.0:1788684117.469835:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38f5 expref: 10 pid: 6490 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684117.469848:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788684117.469855:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:3623:x1875571085728000:12345-0@lo:103: 00010000:00010000:1.0:1788684117.469866:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684117.469871:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac25e expref: 20 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.469894:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac25e expref: 20 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.469912:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030800/0x44bac02bd54ac265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac25e expref: 20 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.469926:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684117.469958:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:3623:x1875571085728000:12345-0@lo:103: Request processed in 104us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684117.469965:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788684117.469979:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788684117.469985:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:3623:x1875571085728512:12345-0@lo:103: 00010000:00010000:1.0:1788684117.469993:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684117.469997:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac1e7 expref: 18 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470006:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac1e7 expref: 18 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470023:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac1ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac1e7 expref: 18 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470032:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684117.470057:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:3623:x1875571085728512:12345-0@lo:103: Request processed in 72us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684117.470062:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788684117.470075:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:1.0:1788684117.470082:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073094400:12345-192.168.206.44@tcp:103: 00010000:00010000:1.0:1788684117.470090:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684117.470094:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38f5 expref: 10 pid: 6490 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470105:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38f5 expref: 10 pid: 6490 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470115:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684117.470152:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073094400:12345-192.168.206.44@tcp:103: Request processed in 70us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684117.470159:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:1.0:1788684117.470221:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684117.470245:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085728640:0@lo:103: 00000100:00100000:1.0:1788684117.470283:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684117.470308:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085728000:0@lo:103: 00000100:00100000:1.0:1788684117.470317:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085728512:0@lo:103: 00000100:00100000:1.0:1788684117.470344:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085728128 00000100:00100000:1.0:1788684117.470353:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085728128 00010000:00010000:1.0:1788684117.470392:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac242 expref: 17 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684117.470406:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085728640 00000100:00100000:1.0:1788684117.470409:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085728640 00010000:00010000:1.0:1788684117.470421:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac1bd expref: 18 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684117.470434:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684117.470439:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:3623:x1875571085728128:12345-0@lo:103: 00010000:00010000:1.0:1788684117.470446:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684117.470451:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac242 expref: 18 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470460:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac242 expref: 18 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470471:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac242 expref: 18 pid: 6491 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470482:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684117.470510:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:3623:x1875571085728128:12345-0@lo:103: Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684117.470516:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684117.470528:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684117.470535:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:3623:x1875571085728640:12345-0@lo:103: 00010000:00010000:1.0:1788684117.470543:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684117.470547:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac1bd expref: 16 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470567:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac1bd expref: 16 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470577:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67820eea00/0x44bac02bd54ac1c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac1bd expref: 16 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470591:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470601:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470618:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470627:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470635:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470644:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470651:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684117.470656:0:6484:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470665:0:6484:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470686:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684117.470699:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684117.470723:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:3623:x1875571085728640:12345-0@lo:103: Request processed in 189us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684117.470730:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684117.470759:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085728128:0@lo:103: 00000100:00100000:1.0:1788684117.470768:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085728640:0@lo:103: 00010000:00010000:0.0:1788684117.471296:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac2ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38fc expref: 9 pid: 6489 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.471309:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726208:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684117.471323:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67820ee000/0x44bac02bd54ac2e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed38f5 expref: 8 pid: 6490 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684117.471331:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875571085726336:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684117.471412:0:10311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.471431:0:10311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.471439:0:10311:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684117.471446:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac329 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684117.472309:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684117.473481:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085726976:0@lo:103: 00000100:00100000:3.0:1788684117.474710:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085726848:0@lo:103: 00010000:00010000:2.0:1788684117.640411:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684118.655124:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684119.224330:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684119.224459:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073094528 00000100:00100000:3.0:1788684119.224468:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073094528 00000100:00100000:3.0:1788684119.224526:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 198 00000100:00100000:3.0:1788684119.224537:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+8:2392:x1875571073094528:12345-192.168.206.44@tcp:400: 00000100:00100000:3.0:1788684119.224607:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+8:2392:x1875571073094528:12345-192.168.206.44@tcp:400: Request processed in 72us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684119.224634:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 198 00000100:00100000:1.0:1788684119.224814:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684119.224856:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684119.224883:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684119.224921:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073094784 00000100:00100000:0.0:1788684119.224921:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073095040 00000100:00100000:1.0:1788684119.224933:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684119.224935:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073094784 00000100:00100000:0.0:1788684119.224935:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073095040 00000100:00100000:3.0:1788684119.225014:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073094656 00000100:00100000:3.0:1788684119.225025:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073094656 00000100:00100000:0.0:1788684119.225251:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073094912 00000100:00100000:0.0:1788684119.225258:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073094912 00000100:00100000:2.0:1788684119.228488:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:2.0:1788684119.228516:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073094784:12345-192.168.206.44@tcp:400: 00000100:00100000:2.0:1788684119.228682:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073094784:12345-192.168.206.44@tcp:400: Request processed in 177us (3870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.228841:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00080000:2.0:1788684119.228886:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684119.228895:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684119.228898:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684119.228901:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684119.229015:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:2.0:1788684119.229026:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073095040:12345-192.168.206.44@tcp:400: 00000100:00100000:2.0:1788684119.229067:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073095040:12345-192.168.206.44@tcp:400: Request processed in 44us (4209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.229075:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:1.0:1788684119.229548:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:1.0:1788684119.229567:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073094656:12345-192.168.206.44@tcp:400: 00000100:00100000:1.0:1788684119.229638:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073094656:12345-192.168.206.44@tcp:400: Request processed in 78us (4753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.229646:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:0.0:1788684119.229803:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:0.0:1788684119.229828:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073094912:12345-192.168.206.44@tcp:400: 00000100:00100000:0.0:1788684119.229875:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073094912:12345-192.168.206.44@tcp:400: Request processed in 62us (4943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684119.229882:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 10000000:01000000:2.0:1788684119.423201:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788684119.423208:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67771bc800 from 48 10000000:01000000:2.0:1788684119.423214:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788684119.423276:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.423304:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.423318:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684119.423344:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085728768:0@lo:101: 00000100:00100000:2.0:1788684119.423455:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.423527:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684119.423562:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085728768 00000100:00100000:0.0:1788684119.423581:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085728768 00000100:00100000:0.0:1788684119.423668:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788684119.423681:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+15:6495:x1875571085728768:12345-0@lo:101: 00010000:00010000:0.0:1788684119.423700:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684119.423724:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac330 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.423759:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac330 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.423792:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac330 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.423804:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740030a00, rc 0) 00000100:00100000:0.0:1788684119.424009:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085728768:12345-0@lo:101: Request processed in 330us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684119.424017:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788684119.425599:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085728768:0@lo:101: 00010000:00010000:2.0:1788684119.425630:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.425643:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684119.425736:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085728896:0@lo:501: 00000100:00100000:2.0:1788684119.425804:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.425858:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684119.425940:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085728896 00000100:00100000:3.0:1788684119.425947:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085728896 00000100:00100000:3.0:1788684119.426051:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788684119.426061:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085728896:12345-0@lo:501: 00000100:00100000:3.0:1788684119.426206:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085728896:12345-0@lo:501: Request processed in 145us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684119.426213:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788684119.426291:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085728896:0@lo:501: 00000100:00100000:2.0:1788684119.426318:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085729024:0@lo:503: 00000100:00100000:2.0:1788684119.426404:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.435606:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.441409:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085729024 00000100:00100000:1.0:1788684119.441424:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085729024 00000100:00100000:1.0:1788684119.441483:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788684119.441493:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085729024:12345-0@lo:503: 00000100:00100000:1.0:1788684119.441647:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085729024:12345-0@lo:503: Request processed in 155us (15282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.441660:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788684119.441794:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085729024:0@lo:503: 00000100:00100000:2.0:1788684119.442207:0:10328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10328:1875571085729152:0@lo:502: 00000100:00100000:2.0:1788684119.442256:0:10328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.442304:0:10328:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.442428:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085729152 00000100:00100000:1.0:1788684119.442433:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085729152 00000100:00100000:1.0:1788684119.442456:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788684119.442462:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:10328:x1875571085729152:12345-0@lo:502: 00000100:00100000:1.0:1788684119.442543:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:10328:x1875571085729152:12345-0@lo:502: Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.442549:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788684119.442728:0:10328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10328:1875571085729152:0@lo:502: 00000100:00100000:2.0:1788684119.442766:0:10328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10328:1875571085729280:0@lo:502: 00000100:00100000:2.0:1788684119.442797:0:10328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.442823:0:10328:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788684119.442877:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085729280 00000100:00100000:3.0:1788684119.442883:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085729280 00000100:00100000:3.0:1788684119.442905:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788684119.442912:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:10328:x1875571085729280:12345-0@lo:502: 00000100:00100000:3.0:1788684119.442992:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:10328:x1875571085729280:12345-0@lo:502: Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684119.442999:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788684119.443076:0:10328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10328:1875571085729280:0@lo:502: 00000040:00080000:2.0:1788684119.443096:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788684119.443328:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788684119.443348:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788684119.443357:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.443404:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684119.443414:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788684119.443417:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788684119.443421:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788684119.443452:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.443461:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.443470:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684119.443483:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085729408:0@lo:101: 00000100:00100000:3.0:1788684119.443513:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.443531:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.443634:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085729408 00000100:00100000:2.0:1788684119.443639:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085729408 00000100:00100000:2.0:1788684119.443661:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788684119.443666:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+16:6495:x1875571085729408:12345-0@lo:101: 00010000:00010000:2.0:1788684119.443675:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684119.443687:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477fe800/0x44bac02bd54ac345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac33e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.443708:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477fe800/0x44bac02bd54ac345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac33e expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.443718:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477fe800/0x44bac02bd54ac345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac33e expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.443728:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477fe800, rc 0) 00000100:00100000:2.0:1788684119.443759:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085729408:12345-0@lo:101: Request processed in 92us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.443765:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788684119.444253:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085729408:0@lo:101: 00010000:00010000:3.0:1788684119.444279:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.444288:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684119.444347:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085729536:0@lo:501: 00000100:00100000:3.0:1788684119.444424:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.444449:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.444813:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085729536 00000100:00100000:2.0:1788684119.444829:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085729536 00000100:00100000:2.0:1788684119.444870:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788684119.444878:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085729536:12345-0@lo:501: 00000100:00100000:2.0:1788684119.444996:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085729536:12345-0@lo:501: Request processed in 119us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.445005:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788684119.445112:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085729536:0@lo:501: 00000100:00100000:3.0:1788684119.445142:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085729664:0@lo:503: 00000100:00100000:3.0:1788684119.445182:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.445209:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.445250:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085729664 00000100:00100000:2.0:1788684119.445254:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085729664 00000100:00100000:2.0:1788684119.445336:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788684119.445343:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085729664:12345-0@lo:503: 00000100:00100000:2.0:1788684119.445826:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085729664:12345-0@lo:503: Request processed in 482us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.445834:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788684119.445899:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085729664:0@lo:503: 00000100:00100000:3.0:1788684119.446102:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10329:1875571085729792:0@lo:502: 00000100:00100000:3.0:1788684119.446140:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.451392:0:10329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684119.455252:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085729792 00000100:00100000:0.0:1788684119.455278:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085729792 00000100:00100000:0.0:1788684119.455336:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788684119.455345:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:10329:x1875571085729792:12345-0@lo:502: 00000100:00100000:0.0:1788684119.455532:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:10329:x1875571085729792:12345-0@lo:502: Request processed in 188us (9390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684119.455539:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788684119.455589:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10329:1875571085729792:0@lo:502: 00000020:01000000:3.0:1788684119.455627:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684119.455638:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684119.455640:0:10329:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788684119.455645:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788684119.455692:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10329:1875571085729920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684119.457995:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.458101:0:10329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.459209:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085729920 00000100:00100000:1.0:1788684119.459220:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085729920 00000100:00100000:1.0:1788684119.459287:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788684119.459298:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:10329:x1875571085729920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684119.459494:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:10329:x1875571085729920:12345-0@lo:502:llog_process_th.0 Request processed in 196us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.459503:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788684119.459666:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10329:1875571085729920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788684119.459701:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684119.459708:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684119.459711:0:10329:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788684119.459715:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788684119.459878:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788684119.459900:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788684119.459911:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.459922:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684119.459932:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788684119.459935:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d677e122800 from 48 10000000:01000000:0.0:1788684119.459938:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788684119.459970:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.459991:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.460002:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684119.460022:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.460058:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684119.460098:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.460190:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085730048 00000100:00100000:2.0:1788684119.460195:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085730048 00000100:00100000:2.0:1788684119.460232:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788684119.460240:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+17:6495:x1875571085730048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684119.460249:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684119.460271:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477fe000/0x44bac02bd54ac353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac34c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.460291:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477fe000/0x44bac02bd54ac353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac34c expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.460301:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477fe000/0x44bac02bd54ac353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac34c expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.460309:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477fe000, rc 0) 00000100:00100000:2.0:1788684119.460356:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085730048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.460362:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788684119.460502:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684119.460516:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.460525:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684119.460575:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.460598:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684119.460627:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.460796:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085730176 00000100:00100000:2.0:1788684119.460801:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085730176 00000100:00100000:2.0:1788684119.460839:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788684119.460846:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085730176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.460986:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085730176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.460994:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788684119.461777:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.461814:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.461925:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684119.461997:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.462039:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085730304 00000100:00100000:1.0:1788684119.462044:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085730304 00000100:00100000:1.0:1788684119.462111:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788684119.462119:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085730304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.462210:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085730304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.462217:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788684119.462295:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.464998:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10330:1875571085730432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684119.465089:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684119.465273:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.465644:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085730432 00000100:00100000:2.0:1788684119.465652:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085730432 00000100:00100000:2.0:1788684119.465690:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788684119.465699:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:10330:x1875571085730432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684119.465990:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10330:1875571085730432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684119.466047:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10330:1875571085730560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684119.466085:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684119.466102:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777145b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.466150:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:10330:x1875571085730432:12345-0@lo:502:llog_process_th.0 Request processed in 452us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.466159:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788684119.466192:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085730560 00000100:00100000:2.0:1788684119.466197:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085730560 00000100:00100000:2.0:1788684119.466214:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788684119.466220:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:10330:x1875571085730560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.466336:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:10330:x1875571085730560:12345-0@lo:502:llog_process_th.0 Request processed in 115us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.466343:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788684119.466693:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10330:1875571085730560:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788684119.466714:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788684119.466937:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788684119.466963:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788684119.466973:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.466984:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684119.466994:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788684119.466997:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788684119.466999:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788684119.467026:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.467044:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.467053:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684119.467068:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.467103:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.467162:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.467193:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085730688 00000100:00100000:2.0:1788684119.467197:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085730688 00000100:00100000:2.0:1788684119.467279:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788684119.467293:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+18:6495:x1875571085730688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684119.467303:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684119.467313:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477fec00/0x44bac02bd54ac361 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac35a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.467332:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477fec00/0x44bac02bd54ac361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac35a expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.467342:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477fec00/0x44bac02bd54ac361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac35a expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.467350:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477fec00, rc 0) 00000100:00100000:2.0:1788684119.467632:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085730688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 339us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.467639:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788684119.467701:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684119.467714:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.467723:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684119.467777:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.467803:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.468164:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.468232:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085730816 00000100:00100000:1.0:1788684119.468237:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085730816 00000100:00100000:1.0:1788684119.468270:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788684119.468279:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085730816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.468423:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085730816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.468431:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788684119.469088:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.469126:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.469169:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.469193:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.469251:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085730944 00000100:00100000:2.0:1788684119.469255:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085730944 00000100:00100000:2.0:1788684119.469292:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788684119.469299:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085730944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.469998:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085730944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 697us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.470007:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788684119.470076:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085730944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.470602:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10331:1875571085731072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684119.470734:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684119.470802:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771450c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.470886:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085731072 00000100:00100000:1.0:1788684119.470891:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085731072 00000100:00100000:1.0:1788684119.470962:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788684119.470971:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:10331:x1875571085731072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684119.471112:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:10331:x1875571085731072:12345-0@lo:502:llog_process_th.0 Request processed in 142us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.471119:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788684119.471200:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10331:1875571085731072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684119.471226:0:10331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684119.471235:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684119.471237:0:10331:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788684119.471241:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788684119.471275:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10331:1875571085731200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.471312:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.471571:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.471743:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085731200 00000100:00100000:1.0:1788684119.471748:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085731200 00000100:00100000:1.0:1788684119.471784:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788684119.471792:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:10331:x1875571085731200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684119.471956:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:10331:x1875571085731200:12345-0@lo:502:llog_process_th.0 Request processed in 164us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.471962:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788684119.472036:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10331:1875571085731200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684119.472060:0:10331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684119.472065:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684119.472067:0:10331:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788684119.472070:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788684119.472279:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788684119.472302:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788684119.472311:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.472321:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684119.472331:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788684119.472333:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d677cc6f800 from 48 10000000:01000000:1.0:1788684119.472342:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788684119.472580:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.472589:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.472599:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684119.472692:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085731328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.472727:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684119.472759:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.472807:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085731328 00000100:00100000:2.0:1788684119.472813:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085731328 00000100:00100000:2.0:1788684119.472908:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788684119.472917:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:6495:x1875571085731328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684119.472927:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684119.472938:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477fea00/0x44bac02bd54ac36f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac368 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.472957:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477fea00/0x44bac02bd54ac36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac368 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.472968:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477fea00/0x44bac02bd54ac36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac368 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.472977:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477fea00, rc 0) 00000100:00100000:2.0:1788684119.473017:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085731328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.473023:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788684119.473086:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085731328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684119.473098:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.473107:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684119.473152:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085731456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.473176:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684119.473199:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.473240:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085731456 00000100:00100000:2.0:1788684119.473244:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085731456 00000100:00100000:2.0:1788684119.473285:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788684119.473293:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085731456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.473430:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085731456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.473437:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788684119.473506:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085731456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.473532:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085731584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.473567:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684119.473600:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.473898:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085731584 00000100:00100000:2.0:1788684119.473903:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085731584 00000100:00100000:2.0:1788684119.473935:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788684119.473942:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085731584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.474023:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085731584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.474029:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788684119.474062:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085731584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.474224:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10332:1875571085731712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.474273:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.474292:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085731712 00000100:00100000:2.0:1788684119.474296:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085731712 00000100:00100000:2.0:1788684119.474311:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788684119.474316:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:10332:x1875571085731712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.474411:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:10332:x1875571085731712:12345-0@lo:502:llog_process_th.0 Request processed in 94us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.474418:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788684119.474449:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677ccd36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.474461:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10332:1875571085731712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.474496:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10332:1875571085731840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.474528:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.474553:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085731840 00000100:00100000:2.0:1788684119.474557:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085731840 00000100:00100000:2.0:1788684119.474571:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788684119.474576:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:10332:x1875571085731840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.474998:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:10332:x1875571085731840:12345-0@lo:502:llog_process_th.0 Request processed in 420us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.475005:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788684119.475036:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677ccd36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.475049:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10332:1875571085731840:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788684119.475068:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788684119.488788:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788684119.488839:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788684119.488851:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.488864:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684119.488876:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788684119.488879:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788684119.488882:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788684119.488918:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.488927:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684119.488939:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684119.488961:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085731968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684119.489018:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684119.489066:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771450c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.490836:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085731968 00000100:00100000:1.0:1788684119.490848:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085731968 00000100:00100000:1.0:1788684119.490907:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788684119.490917:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085731968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684119.490931:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684119.490947:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a0600/0x44bac02bd54ac37d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac376 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.490973:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0600/0x44bac02bd54ac37d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac376 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.490983:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a0600/0x44bac02bd54ac37d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac376 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.490991:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0600, rc 0) 00000100:00100000:1.0:1788684119.491063:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085731968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.491084:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788684119.491175:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085731968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684119.491198:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.491208:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684119.491287:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.491318:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.491354:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.491537:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085732096 00000100:00100000:1.0:1788684119.491542:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085732096 00000100:00100000:1.0:1788684119.491574:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788684119.491581:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085732096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.491694:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085732096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.491700:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788684119.491823:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.491864:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.491901:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.491928:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:3.0:1788684119.491940:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085732224 00000100:00100000:3.0:1788684119.491943:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085732224 00000100:00100000:3.0:1788684119.491960:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788684119.491966:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085732224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.492055:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085732224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684119.492062:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788684119.492237:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.492938:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10333:1875571085732352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.492986:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.493017:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677ccd3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788684119.493080:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085732352 00000100:00100000:3.0:1788684119.493086:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085732352 00000100:00100000:3.0:1788684119.493118:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788684119.493125:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:10333:x1875571085732352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684119.493211:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:10333:x1875571085732352:12345-0@lo:502:llog_process_th.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684119.493229:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788684119.499023:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10333:1875571085732352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684119.499093:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684119.499106:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684119.499108:0:10333:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788684119.499114:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788684119.499153:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10333:1875571085732480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.499226:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.499281:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.500725:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085732480 00000100:00100000:1.0:1788684119.500736:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085732480 00000100:00100000:1.0:1788684119.500789:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788684119.500798:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:10333:x1875571085732480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684119.500963:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:10333:x1875571085732480:12345-0@lo:502:llog_process_th.0 Request processed in 166us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.500971:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788684119.501119:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10333:1875571085732480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684119.501158:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684119.501165:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684119.501168:0:10333:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788684119.501199:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788684119.501585:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788684119.501620:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788684119.501631:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.501641:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684119.501651:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788684119.501654:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67466b4800 from 48 10000000:01000000:1.0:1788684119.501657:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788684119.501686:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.501701:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.501710:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684119.501729:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.501767:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684119.501803:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.502014:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085732608 00000100:00100000:2.0:1788684119.502020:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085732608 00000100:00100000:2.0:1788684119.502060:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788684119.502078:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085732608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684119.502097:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684119.502110:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477ffa00/0x44bac02bd54ac38b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac384 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.502133:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477ffa00/0x44bac02bd54ac38b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac384 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.502149:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477ffa00/0x44bac02bd54ac38b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac384 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.502158:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477ffa00, rc 0) 00000100:00100000:2.0:1788684119.502205:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085732608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.502212:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788684119.502580:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684119.502594:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.502603:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684119.502661:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.502699:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.502725:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.504084:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085732736 00000100:00100000:1.0:1788684119.504094:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085732736 00000100:00100000:1.0:1788684119.504148:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788684119.504157:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085732736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.504936:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085732736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 778us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.504944:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788684119.505229:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.505287:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.505341:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.505436:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.505602:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085732864 00000100:00100000:2.0:1788684119.505608:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085732864 00000100:00100000:2.0:1788684119.505643:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788684119.505650:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085732864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.505741:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085732864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.505748:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788684119.506920:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085732864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.507566:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10334:1875571085732992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684119.507621:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684119.507658:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.507703:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085732992 00000100:00100000:2.0:1788684119.507709:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085732992 00000100:00100000:2.0:1788684119.507749:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788684119.507758:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:10334:x1875571085732992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.507848:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:10334:x1875571085732992:12345-0@lo:502:llog_process_th.0 Request processed in 91us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.507863:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788684119.507943:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10334:1875571085732992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684119.507984:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10334:1875571085733120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684119.508035:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684119.508061:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.508116:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085733120 00000100:00100000:2.0:1788684119.508121:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085733120 00000100:00100000:2.0:1788684119.508157:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788684119.508175:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:10334:x1875571085733120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.508247:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:10334:x1875571085733120:12345-0@lo:502:llog_process_th.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.508256:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788684119.508408:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10334:1875571085733120:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788684119.508428:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788684119.508659:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788684119.508681:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788684119.508689:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.508701:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684119.508711:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788684119.508713:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1788684119.508716:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788684119.508741:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.508749:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.508758:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684119.508772:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085733248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.508805:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.508869:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684119.511334:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085733248 00000100:00100000:1.0:1788684119.511346:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085733248 00000100:00100000:1.0:1788684119.511411:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788684119.511421:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085733248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684119.511436:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684119.511453:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a1000/0x44bac02bd54ac399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac392 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.511479:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1000/0x44bac02bd54ac399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac392 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.511491:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a1000/0x44bac02bd54ac399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac392 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.511500:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1000, rc 0) 00000100:00100000:1.0:1788684119.511571:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085733248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684119.511578:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788684119.511713:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085733248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684119.511731:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.511742:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684119.511812:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085733376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.511846:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684119.511882:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684119.511937:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085733376 00000100:00100000:3.0:1788684119.511943:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085733376 00000100:00100000:3.0:1788684119.511977:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788684119.511985:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085733376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.512098:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085733376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684119.512105:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788684119.512276:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085733376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.512307:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085733504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.512350:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684119.512409:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.512513:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085733504 00000100:00100000:2.0:1788684119.512518:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085733504 00000100:00100000:2.0:1788684119.512548:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788684119.512555:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085733504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.512643:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085733504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.512649:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788684119.512766:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085733504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684119.513935:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10335:1875571085733632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684119.513997:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.514104:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.514131:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085733632 00000100:00100000:2.0:1788684119.514137:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085733632 00000100:00100000:2.0:1788684119.514180:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788684119.514188:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:10335:x1875571085733632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.514306:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:10335:x1875571085733632:12345-0@lo:502:llog_process_th.0 Request processed in 118us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.514313:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788684119.514482:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10335:1875571085733632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788684119.514514:0:10335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684119.514522:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684119.514525:0:10335:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788684119.514532:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788684119.514553:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10335:1875571085733760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684119.514586:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684119.514613:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.514655:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085733760 00000100:00100000:2.0:1788684119.514660:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085733760 00000100:00100000:2.0:1788684119.514692:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788684119.514699:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:10335:x1875571085733760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684119.514774:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:10335:x1875571085733760:12345-0@lo:502:llog_process_th.0 Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.514781:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788684119.515219:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10335:1875571085733760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788684119.515243:0:10335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684119.515249:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684119.515251:0:10335:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788684119.515255:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788684119.515345:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788684119.515398:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788684119.515408:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.515418:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684119.515427:0:6495:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788684119.515430:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d67482e3380 from 1 10000000:01000000:1.0:1788684119.515432:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788684119.515457:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.515464:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.515479:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684119.515495:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085733888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.515528:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684119.515542:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.515597:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085733888 00000100:00100000:2.0:1788684119.515602:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085733888 00000100:00100000:2.0:1788684119.515640:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788684119.515647:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085733888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684119.515656:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684119.515666:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477ffc00/0x44bac02bd54ac3a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac3a0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.515684:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477ffc00/0x44bac02bd54ac3a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac3a0 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.515694:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477ffc00/0x44bac02bd54ac3a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac3a0 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.515703:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477ffc00, rc 0) 00000100:00100000:2.0:1788684119.515849:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085733888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684119.515856:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788684119.515948:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085733888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684119.515961:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684119.515968:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac3a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684119.516278:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085734016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684119.516313:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684119.516396:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684119.516436:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085734016 00000100:00100000:2.0:1788684119.516441:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085734016 00000100:00100000:2.0:1788684119.516500:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788684119.516508:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085734016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684119.516593:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085734016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (279us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788684119.516600:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788684119.516631:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085734016:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788684119.516654:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788684119.516660:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684119.516668:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684119.677610:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684120.122201:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684120.124333:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073095168 00000100:00100000:3.0:1788684120.124347:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073095168 00000100:00100000:3.0:1788684120.124449:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 241 00000100:00100000:3.0:1788684120.124460:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+8:6161:x1875571073095168:12345-192.168.206.44@tcp:101: 00010000:00010000:3.0:1788684120.124477:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684120.124507:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711dc00/0x44bac02bd54ac3ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed396c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684120.124536:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711dc00/0x44bac02bd54ac3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed396c expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684120.124548:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711dc00/0x44bac02bd54ac3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed396c expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684120.124557:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711dc00, rc 0) 00000100:00100000:3.0:1788684120.124630:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6161:x1875571073095168:12345-192.168.206.44@tcp:101: Request processed in 172us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684120.124637:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 241 00000100:00100000:2.0:1788684120.139584:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684120.139699:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073095296 00000100:00100000:1.0:1788684120.139708:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073095296 00000100:00100000:1.0:1788684120.139766:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 242 00000100:00100000:1.0:1788684120.139786:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6161:x1875571073095296:12345-192.168.206.44@tcp:501: 00000100:00100000:1.0:1788684120.139934:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6161:x1875571073095296:12345-192.168.206.44@tcp:501: Request processed in 160us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684120.139942:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 242 00000100:00100000:2.0:1788684120.157737:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684120.157972:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073095424 00000100:00100000:1.0:1788684120.157982:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073095424 00000100:00100000:1.0:1788684120.158038:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 243 00000100:00100000:1.0:1788684120.158048:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6161:x1875571073095424:12345-192.168.206.44@tcp:503: 00000100:00100000:1.0:1788684120.158189:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6161:x1875571073095424:12345-192.168.206.44@tcp:503: Request processed in 141us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684120.158196:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 243 00000100:00100000:2.0:1788684120.168030:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684120.168301:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073095552 00000100:00100000:3.0:1788684120.168311:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073095552 00000100:00100000:3.0:1788684120.168389:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:3.0:1788684120.168400:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6647:x1875571073095552:12345-192.168.206.44@tcp:502: 00000100:00100000:3.0:1788684120.168541:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6647:x1875571073095552:12345-192.168.206.44@tcp:502: Request processed in 143us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684120.168549:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:3.0:1788684120.172313:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684120.172520:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073095680 00000100:00100000:2.0:1788684120.172529:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073095680 00000100:00100000:2.0:1788684120.172579:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:2.0:1788684120.172588:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6647:x1875571073095680:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684120.172725:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6647:x1875571073095680:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 137us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684120.172733:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:2.0:1788684120.181677:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684120.182808:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073095808 00000100:00100000:1.0:1788684120.182818:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073095808 00000100:00100000:1.0:1788684120.182880:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 246 00000100:00100000:1.0:1788684120.182889:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6161:x1875571073095808:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684120.182905:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684120.182923:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54ac3b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3973 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684120.182950:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54ac3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3973 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684120.182976:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54ac3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3973 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684120.182986:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0e00, rc 0) 00000100:00100000:1.0:1788684120.183045:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6161:x1875571073095808:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 157us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684120.183052:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 246 00000100:00100000:1.0:1788684120.202334:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684120.202873:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073095936 00000100:00100000:3.0:1788684120.202884:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073095936 00000100:00100000:3.0:1788684120.202934:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 247 00000100:00100000:3.0:1788684120.202944:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6161:x1875571073095936:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684120.203052:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6161:x1875571073095936:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 109us (725us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788684120.203075:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 247 00010000:00010000:2.0:1788684120.703946:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684121.214548:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085734144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684121.214610:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684121.214686:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085734144 00000100:00100000:2.0:1788684121.214693:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085734144 00000100:00100000:2.0:1788684121.214754:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788684121.214763:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085734144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684121.214790:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684121.214832:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085734144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684121.214839:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788684121.214873:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788684121.214902:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa70e00 x1875571085734144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684121.214921:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085734144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684121.215494:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085734400:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.215541:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684121.215823:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085734400 00000100:00100000:2.0:1788684121.215829:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085734400 00000100:00100000:2.0:1788684121.215914:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788684121.215923:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085734400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684121.215962:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085734400:12345-0@lo:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684121.215968:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788684121.216002:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085734272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684121.216027:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684121.216056:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085734272 00000100:00100000:2.0:1788684121.216060:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085734272 00000100:00100000:2.0:1788684121.216089:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788684121.216096:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085734272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684121.216108:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684121.216150:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085734272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684121.216156:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788684121.216170:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788684121.216186:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d30a80 x1875571085734272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684121.216199:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085734272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684121.218815:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085734400:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.219096:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085734912:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.219162:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684121.219196:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085735424:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.219221:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684121.219237:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788684121.219243:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085734528:0@lo:400:kworker.0 00000100:00100000:1.0:1788684121.219413:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085734912 00000100:00100000:1.0:1788684121.219419:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085734912 00000100:00100000:1.0:1788684121.219458:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684121.219466:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085734912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684121.219512:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085734912:12345-0@lo:400:kworker.0 Request processed in 47us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684121.219519:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788684121.219594:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684121.220177:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085735040:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.220205:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684121.220660:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085734656:0@lo:400:kworker.0 00000100:00100000:3.0:1788684121.220700:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684121.220721:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085735168:0@lo:400:kworker.0 00000100:00100000:3.0:1788684121.220749:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085734656 00000100:00100000:3.0:1788684121.220754:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085734656 00000100:00100000:3.0:1788684121.220786:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788684121.220794:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085734656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684121.220832:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085734656:12345-0@lo:400:kworker.0 Request processed in 39us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684121.220838:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788684121.221863:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085735552:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.221903:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684121.221941:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085734912:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.221971:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085735552 00000100:00100000:0.0:1788684121.221976:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085735552 00000100:00100000:0.0:1788684121.222015:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788684121.222022:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085735552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.222060:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085735552:12345-0@lo:400:kworker.0 Request processed in 38us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684121.222067:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788684121.222083:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788684121.222103:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a4000 x1875571085735552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684121.222140:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085735552:0@lo:400:kworker.0 00000100:00100000:1.0:1788684121.222556:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085735424 00000100:00100000:1.0:1788684121.222562:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085735424 00000100:00080000:0.0:1788684121.222620:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684121.225725:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085734528 00000100:00100000:2.0:1788684121.225751:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085734528 00000100:00100000:0.0:1788684121.225876:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085734784:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.225939:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684121.230036:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085735296:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.230093:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684121.231333:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085735040 00000100:00100000:3.0:1788684121.231343:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085735040 00000100:00100000:3.0:1788684121.231413:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085734784 00000100:00100000:3.0:1788684121.231417:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085734784 00000100:00100000:3.0:1788684121.231437:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788684121.231446:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085735424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684121.231517:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085735424:12345-0@lo:400:kworker.0 Request processed in 72us (12294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684121.231525:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788684121.231612:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788684121.231620:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085734528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684121.231655:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085734528:12345-0@lo:400:kworker.0 Request processed in 36us (12061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684121.231661:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788684121.231691:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788684121.231698:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085735040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684121.231731:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085735040:12345-0@lo:400:kworker.0 Request processed in 34us (11525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684121.231737:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788684121.231752:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788684121.231759:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085734784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684121.231788:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085734784:12345-0@lo:400:kworker.0 Request processed in 29us (5849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684121.231794:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788684121.231819:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684121.231856:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085734528:0@lo:400:kworker.0 00000100:00100000:3.0:1788684121.231870:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085735040:0@lo:400:kworker.0 00010000:00080000:3.0:1788684121.231884:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a4380 x1875571085735424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684121.231895:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085735424:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.236341:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085734784:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.236398:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085735296 00000100:00100000:0.0:1788684121.236404:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085735296 00000100:00100000:0.0:1788684121.236454:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788684121.236461:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085735296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.236524:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085735296:12345-0@lo:400:kworker.0 Request processed in 63us (6430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684121.236531:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788684121.236552:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684121.236564:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684121.236591:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085735680:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.236620:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684121.236650:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085734656:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.236669:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085735680 00000100:00100000:0.0:1788684121.236672:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085735680 00000100:00100000:0.0:1788684121.236714:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788684121.236721:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085735680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.236755:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085735680:12345-0@lo:400:kworker.0 Request processed in 34us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684121.236769:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788684121.236787:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788684121.236805:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a6d80 x1875571085735680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684121.236816:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085735680:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.236837:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085735296:0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.236932:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085735168 00000100:00100000:0.0:1788684121.236936:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085735168 00000100:00080000:0.0:1788684121.236953:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684121.236976:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788684121.236981:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085735168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684121.237017:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085735168:12345-0@lo:400:kworker.0 Request processed in 36us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684121.237022:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788684121.237044:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5180 x1875571085735168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684121.237052:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085735168:0@lo:400:kworker.0 00000020:00000080:0.0:1788684121.536118:0:10372:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedff4af80 20000000:00000080:0.0:1788684121.536133:0:10372:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d677fad5400 uarg=0000000000000000 20000000:01000000:0.0:1788684121.536169:0:10372:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788684121.536173:0:10372:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788684121.536178:0:10372:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788684121.540066:0:10373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788684121.540286:0:10372:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788684121.544917:0:10372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788684121.544955:0:10372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788684121.544972:0:10372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788684121.544987:0:10372:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788684121.545005:0:10372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.545023:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d674148a000/0x44bac02bd54ac004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54abffd expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.545031:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac051 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.545179:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac0b3 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.545186:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac1d9 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.545196:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3934 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.545204:0:10372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.545242:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3934 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.545269:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3934 expref: 9 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.545284:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085735808:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684121.549149:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac1d9 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.550872:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac1d9 expref: 23 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.550892:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085735936:0@lo:104: 00000100:00100000:1.0:1788684121.550952:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684121.550990:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac0b3 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.551462:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac0b3 expref: 23 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.551473:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085736064:0@lo:104: 00000100:00100000:1.0:1788684121.551504:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684121.551555:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac051 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.551564:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac051 expref: 23 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.551572:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085736192:0@lo:104: 00010000:00010000:1.0:1788684121.551597:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d674148a000/0x44bac02bd54ac004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54abffd expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.551605:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d674148a000/0x44bac02bd54ac004 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54abffd expref: 23 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.551613:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085736320:0@lo:104: 00000100:00100000:1.0:1788684121.551630:0:10372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684121.551647:0:9498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788684121.551669:0:9498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684121.551695:0:9498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684121.551704:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085735936 00000100:00100000:3.0:1788684121.551710:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085735936 00000100:00100000:1.0:1788684121.551739:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085736064 00000100:00100000:1.0:1788684121.551744:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085736064 00000100:00100000:3.0:1788684121.551747:0:9498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085736192 00000100:00100000:3.0:1788684121.551752:0:9498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085736192 00000100:00100000:1.0:1788684121.551771:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085736320 00000100:00100000:3.0:1788684121.551776:0:9498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684121.551776:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085736320 00000100:00100000:3.0:1788684121.551789:0:9498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:10372:x1875571085735936:12345-0@lo:104: 00000100:00100000:1.0:1788684121.551800:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684121.551811:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:10372:x1875571085736064:12345-0@lo:104: 00010000:00010000:3.0:1788684121.551812:0:9498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.551822:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684121.551881:0:9498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788684121.551894:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788684121.551901:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:10372:x1875571085736064:12345-0@lo:104: Request processed in 93us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684121.551908:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684121.551928:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788684121.551932:0:6480:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1788684121.551937:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:10372:x1875571085736192:12345-0@lo:104: 00000100:00100000:2.0:1788684121.551943:0:6480:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:1.0:1788684121.551946:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.551961:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684121.551968:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.551977:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740031400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684121.551981:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.551985:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788684121.551994:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.551994:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:10372:x1875571085736192:12345-0@lo:104: Request processed in 59us (324us total) trans 0 rc 0/0 10000000:00010000:2.0:1788684121.552009:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684121.552016:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684121.552043:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552050:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788684121.552057:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1788684121.552067:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.552075:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788684121.552079:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac1d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac1e0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.552086:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:10372:x1875571085736320:12345-0@lo:104: 00010000:00010000:1.0:1788684121.552097:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552100:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684121.552106:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.552131:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788684121.552140:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:10372:x1875571085736320:12345-0@lo:104: Request processed in 56us (443us total) trans 0 rc 0/0 00010000:00010000:2.0:1788684121.552142:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d674148a800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684121.552148:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.552151:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788684121.552161:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684121.552168:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684121.552173:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684121.552189:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552194:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684121.552215:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552222:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d674148a800/0x44bac02bd54ac0b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac0ba expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552233:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684121.552236:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552242:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a6a00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684121.552244:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552272:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684121.552279:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684121.552283:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684121.552296:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552300:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684121.552306:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552312:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a6a00/0x44bac02bd54ac051 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac058 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552322:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684121.552326:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552331:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a7600 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684121.552334:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552340:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684121.552346:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684121.552357:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684121.552395:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552401:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684121.552407:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552413:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a7600/0x44bac02bd54abffd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.552428:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684121.552429:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684121.552431:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684121.552434:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085736576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684121.552439:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684121.552466:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684121.552499:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684121.552506:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085736704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684121.552525:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684121.552610:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684121.552651:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085736576 00000100:00100000:1.0:1788684121.552655:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085736576 00010000:00010000:1.0:1788684121.552676:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac0b3 expref: 24 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.552703:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085736704 00000100:00100000:1.0:1788684121.552706:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085736704 00000100:00100000:3.0:1788684121.552708:0:9498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:10372:x1875571085735936:12345-0@lo:104: Request processed in 921us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684121.552719:0:9498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788684121.552720:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac051 expref: 25 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.552745:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788684121.552752:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+25:3623:x1875571085736576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684121.552761:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684121.552766:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac0b3 expref: 25 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.552776:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac0b3 expref: 25 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.552790:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684121.552823:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+25:3623:x1875571085736576:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684121.552829:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788684121.552840:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788684121.552845:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085736704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684121.552852:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684121.552856:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac051 expref: 24 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.552873:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac051 expref: 24 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.552882:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684121.552900:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085736704:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684121.552907:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788684121.554070:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085736704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684121.554082:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085736576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684121.554796:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684121.554951:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073096064 00000100:00100000:1.0:1788684121.554957:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073096064 00010000:00010000:1.0:1788684121.554987:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3934 expref: 10 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684121.555027:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:1.0:1788684121.555036:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2393:x1875571073096064:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684121.555047:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684121.555052:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3934 expref: 10 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.555065:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3934 expref: 10 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684121.555081:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684121.555123:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2393:x1875571073096064:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684121.555131:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:0.0:1788684121.555803:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085736448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684121.555847:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684121.556119:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684121.556126:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085736832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684121.556153:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684121.556223:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67820ee400/0x44bac02bd54ac2f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3934 expref: 9 pid: 6489 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684121.556236:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085735808:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684121.556247:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085735936:0@lo:104: 00010000:00010000:0.0:1788684121.556268:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac0ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac0b3 expref: 23 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684121.556276:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085736064:0@lo:104: 00010000:00010000:0.0:1788684121.556296:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67820efc00/0x44bac02bd54ac058 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac051 expref: 22 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684121.556307:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085736192:0@lo:104: 00000100:00100000:0.0:1788684121.556317:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875571085736320:0@lo:104: 00010000:00010000:0.0:1788684121.556342:0:10372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684121.556454:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085736448 00000100:00100000:2.0:1788684121.556460:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085736448 00010000:00010000:2.0:1788684121.556485:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac1d9 expref: 22 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684121.556504:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085736832 00000100:00100000:2.0:1788684121.556507:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085736832 00010000:00010000:2.0:1788684121.556516:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d674148a000/0x44bac02bd54ac004 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abffd expref: 23 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684121.556546:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788684121.556553:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3626:x1875571085736448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684121.556562:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684121.556574:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac1d9 expref: 23 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556583:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac1d9 expref: 23 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556597:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148aa00/0x44bac02bd54ac1e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac1d9 expref: 23 pid: 6491 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556608:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684121.556640:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3626:x1875571085736448:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684121.556646:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788684121.556683:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684121.556688:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3626:x1875571085736832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684121.556695:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684121.556698:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d674148a000/0x44bac02bd54ac004 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54abffd expref: 21 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556705:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d674148a000/0x44bac02bd54ac004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54abffd expref: 21 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556714:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148a000/0x44bac02bd54ac004 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54abffd expref: 21 pid: 6489 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556724:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556731:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556754:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556762:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556769:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556776:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556782:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684121.556786:0:6483:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556793:0:6483:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556805:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684121.556814:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684121.556838:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:3626:x1875571085736832:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684121.556844:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788684121.557140:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085736832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684121.557150:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085736448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684121.557172:0:10372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684121.557180:0:10372:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684121.557196:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a0000/0x44bac02bd54ac3bc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684121.727869:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085736960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684121.727929:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684121.727995:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085736960 00000100:00100000:2.0:1788684121.728007:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085736960 00000100:00100000:2.0:1788684121.728049:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684121.728057:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085736960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684121.728083:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684121.728124:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085736960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684121.728131:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788684121.728173:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa72d80 x1875571085736960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684121.728190:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085736960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684121.728354:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085737088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684121.728404:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684121.728482:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684121.728500:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085737088 00000100:00100000:1.0:1788684121.728504:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085737088 00000100:00100000:1.0:1788684121.728548:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788684121.728555:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085737088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684121.728577:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684121.728617:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085737088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684121.728623:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788684121.728653:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085737088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684121.728781:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085737216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684121.728808:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684121.728835:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085737216 00000100:00100000:2.0:1788684121.728839:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085737216 00000100:00100000:2.0:1788684121.728861:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788684121.728867:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085737216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684121.728877:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684121.728906:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085737216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684121.728912:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788684121.728936:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa72d80 x1875571085737216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684121.728948:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085737216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684122.237640:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684122.237670:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085737344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684122.237761:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684122.238005:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085737344 00000100:00100000:0.0:1788684122.238015:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085737344 00000100:00100000:0.0:1788684122.238085:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684122.238096:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085737344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684122.238140:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788684122.238204:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085737344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684122.238212:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788684122.238354:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085737344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684122.753855:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788684122.948081:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684122.948110:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67771bc800 from 4 10000000:01000000:2.0:1788684122.948116:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684122.948176:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684122.948191:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684122.948205:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684122.948238:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085737472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684122.948344:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684122.948433:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684122.948463:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085737472 00000100:00100000:2.0:1788684122.948472:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085737472 00000100:00100000:2.0:1788684122.948531:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788684122.948542:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085737472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684122.948558:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684122.948575:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac3c3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684122.948617:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac3c3 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684122.948631:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac3c3 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684122.948642:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477ff200, rc 0) 00000100:00100000:2.0:1788684122.948687:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085737472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684122.948702:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788684122.948764:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085737472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684122.948783:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684122.948793:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684122.948869:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085737600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684122.948897:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684122.948915:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684122.949990:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085737600 00000100:00100000:0.0:1788684122.950004:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085737600 00000100:00100000:0.0:1788684122.950055:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788684122.950066:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085737600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.950260:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085737600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684122.950269:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788684122.950327:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085737600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.950449:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085737728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.950499:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684122.950521:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67770fb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684122.950543:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085737728 00000100:00100000:0.0:1788684122.950547:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085737728 00000100:00100000:0.0:1788684122.950571:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788684122.950578:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085737728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.950664:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085737728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684122.950671:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788684122.950715:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085737728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684122.961215:0:10441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10441:1875571085737856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684122.961335:0:10441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684122.961412:0:10441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684122.962978:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085737856 00000100:00100000:0.0:1788684122.962995:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085737856 00000100:00100000:0.0:1788684122.963064:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788684122.963077:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:10441:x1875571085737856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684122.963293:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:10441:x1875571085737856:12345-0@lo:502:llog_process_th.0 Request processed in 218us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684122.963303:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788684122.964228:0:10441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10441:1875571085737856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684122.964296:0:10441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684122.964308:0:10441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684122.964310:0:10441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788684122.964318:0:10441:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67771bc800 00000020:00000080:0.0:1788684122.964321:0:10441:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788684122.964444:0:10441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10441:1875571085737984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684122.964509:0:10441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684122.964554:0:10441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67770fbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684122.965973:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085737984 00000100:00100000:2.0:1788684122.965988:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085737984 00000100:00100000:2.0:1788684122.966063:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788684122.966075:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:10441:x1875571085737984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684122.966285:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:10441:x1875571085737984:12345-0@lo:502:llog_process_th.0 Request processed in 211us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684122.966293:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788684122.968443:0:10441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10441:1875571085737984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684122.968504:0:10441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684122.968521:0:10441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684122.968524:0:10441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788684122.968532:0:10441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788684122.968628:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788684122.968657:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684122.968670:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684122.968684:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684122.968696:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684122.968700:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677e122800 from 4 10000000:01000000:0.0:1788684122.968703:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684122.968745:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684122.968754:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684122.968764:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684122.968790:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.968861:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684122.968905:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67770fbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684122.968925:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085738112 00000100:00100000:0.0:1788684122.968931:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085738112 00000100:00100000:0.0:1788684122.968982:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788684122.968991:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085738112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684122.969004:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684122.969024:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac3d1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684122.969051:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac3d1 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684122.969062:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac3d1 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684122.969071:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740031600, rc 0) 00000100:00100000:0.0:1788684122.969110:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085738112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684122.969117:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788684122.969160:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684122.969174:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684122.969184:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684122.974640:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.974757:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684122.974821:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67770fbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684122.974855:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085738240 00000100:00100000:0.0:1788684122.974863:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085738240 00000100:00100000:0.0:1788684122.974919:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788684122.974929:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085738240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.975082:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085738240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684122.975109:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788684122.982154:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.982257:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.982357:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684122.982422:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67770fbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684122.982460:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085738368 00000100:00100000:0.0:1788684122.982468:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085738368 00000100:00100000:0.0:1788684122.982520:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788684122.982530:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085738368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684122.982658:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085738368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684122.982667:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788684122.982730:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.006232:0:10444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10444:1875571085738496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684123.006354:0:10444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684123.006424:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085738496 00000100:00100000:0.0:1788684123.006433:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085738496 00000100:00100000:0.0:1788684123.006483:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788684123.006493:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:10444:x1875571085738496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684123.008587:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:10444:x1875571085738496:12345-0@lo:502:llog_process_th.0 Request processed in 2087us (2227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.008603:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788684123.008691:0:10444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684123.008721:0:10444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10444:1875571085738496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684123.008774:0:10444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684123.008787:0:10444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684123.008790:0:10444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788684123.008800:0:10444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d677e122800 00000020:00000080:0.0:1788684123.008802:0:10444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788684123.014071:0:10444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10444:1875571085738624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684123.014172:0:10444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684123.014223:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085738624 00000100:00100000:0.0:1788684123.014232:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085738624 00000100:00100000:0.0:1788684123.014304:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788684123.014314:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:10444:x1875571085738624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684123.014482:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:10444:x1875571085738624:12345-0@lo:502:llog_process_th.0 Request processed in 168us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.014491:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788684123.014558:0:10444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684123.014585:0:10444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10444:1875571085738624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684123.014798:0:10444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684123.014809:0:10444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684123.014811:0:10444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788684123.014818:0:10444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788684123.014943:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788684123.014970:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684123.014983:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.014996:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684123.015018:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684123.015021:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677cc6f800 from 4 10000000:01000000:0.0:1788684123.015024:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684123.015059:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.015067:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.015077:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684123.015091:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.015123:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684123.015138:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684123.015154:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085738752 00000100:00100000:0.0:1788684123.015159:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085738752 00000100:00100000:0.0:1788684123.015183:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788684123.015190:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085738752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684123.015200:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684123.015215:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac3df expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.015239:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac3df expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.015262:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac3df expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.015282:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740031800, rc 0) 00000100:00100000:0.0:1788684123.015313:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085738752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.015319:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788684123.015350:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684123.015385:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.015395:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684123.015447:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.015470:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684123.015482:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684123.015495:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085738880 00000100:00100000:0.0:1788684123.015498:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085738880 00000100:00100000:0.0:1788684123.015519:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788684123.015527:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085738880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.017797:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085738880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2258us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.017813:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788684123.017890:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085738880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.017953:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085739008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.018011:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684123.018048:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684123.018064:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085739008 00000100:00100000:0.0:1788684123.018070:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085739008 00000100:00100000:0.0:1788684123.018106:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788684123.018114:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085739008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.018212:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085739008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.018218:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788684123.018269:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085739008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684123.020059:0:10446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10446:1875571085739136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684123.020135:0:10446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684123.020184:0:10446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684123.022854:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085739136 00000100:00100000:0.0:1788684123.022871:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085739136 00000100:00100000:0.0:1788684123.022939:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788684123.022951:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:10446:x1875571085739136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684123.023153:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:10446:x1875571085739136:12345-0@lo:502:llog_process_th.0 Request processed in 204us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.023162:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788684123.023212:0:10446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10446:1875571085739136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684123.023278:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684123.023289:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684123.023293:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788684123.023304:0:10446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d677cc6f800 00000020:00000080:2.0:1788684123.023307:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788684123.023418:0:10446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10446:1875571085739264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684123.023467:0:10446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684123.023492:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085739264 00000100:00100000:0.0:1788684123.023496:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085739264 00000100:00100000:2.0:1788684123.023507:0:10446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684123.023519:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788684123.023526:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:10446:x1875571085739264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684123.023607:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:10446:x1875571085739264:12345-0@lo:502:llog_process_th.0 Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.023614:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788684123.023644:0:10446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10446:1875571085739264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684123.023844:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684123.023849:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684123.023850:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788684123.023856:0:10446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788684123.024007:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788684123.024038:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684123.024050:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.024068:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684123.024080:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684123.024083:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67466b4800 from 4 10000000:01000000:0.0:1788684123.024087:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684123.024118:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.024125:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.024135:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684123.024150:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085739392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.024184:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684123.024211:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684123.024886:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085739392 00000100:00100000:2.0:1788684123.024895:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085739392 00000100:00100000:2.0:1788684123.024948:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788684123.024956:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085739392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684123.024969:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684123.024984:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac3ed expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684123.025009:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac3ed expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684123.025020:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac3ed expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684123.025029:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477ff400, rc 0) 00000100:00100000:2.0:1788684123.025074:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085739392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684123.025088:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788684123.025136:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085739392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684123.025154:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684123.025163:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684123.025227:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085739520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684123.025269:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684123.025286:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788684123.025299:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085739520 00000100:00100000:2.0:1788684123.025302:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085739520 00000100:00100000:2.0:1788684123.025326:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788684123.025331:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085739520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684123.025468:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085739520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684123.025476:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788684123.025505:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085739520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684123.025534:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085739648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684123.025589:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684123.025602:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674334a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788684123.025617:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085739648 00000100:00100000:2.0:1788684123.025621:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085739648 00000100:00100000:2.0:1788684123.025642:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788684123.025655:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085739648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684123.028201:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085739648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2541us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684123.028214:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788684123.028312:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085739648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684123.032219:0:10448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10448:1875571085739776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684123.037396:0:10448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684123.037455:0:10448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684123.037531:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085739776 00000100:00100000:0.0:1788684123.037549:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085739776 00000100:00100000:0.0:1788684123.037623:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788684123.037636:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:10448:x1875571085739776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684123.037862:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:10448:x1875571085739776:12345-0@lo:502:llog_process_th.0 Request processed in 228us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.037871:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788684123.038838:0:10448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10448:1875571085739776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684123.038889:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684123.038903:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684123.038906:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788684123.038920:0:10448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67466b4800 00000020:00000080:2.0:1788684123.038923:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788684123.039035:0:10448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10448:1875571085739904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684123.039099:0:10448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684123.039728:0:10448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684123.039873:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085739904 00000100:00100000:0.0:1788684123.039881:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085739904 00000100:00100000:0.0:1788684123.039935:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788684123.039955:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:10448:x1875571085739904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684123.040103:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:10448:x1875571085739904:12345-0@lo:502:llog_process_th.0 Request processed in 149us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.040318:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788684123.040440:0:10448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:10448:1875571085739904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684123.040479:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684123.040487:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684123.040490:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788684123.040499:0:10448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788684123.041258:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788684123.041300:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684123.041314:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.041327:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684123.513053:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684123.513128:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073096192 00000100:00100000:0.0:1788684123.513138:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073096192 00000100:00100000:0.0:1788684123.513249:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 269 00000100:00100000:0.0:1788684123.513261:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+9:6161:x1875571073096192:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684123.513290:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684123.513308:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed397a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.513337:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed397a expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.513348:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed397a expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684123.513358:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6740030000, rc 0) 00000100:00100000:0.0:1788684123.513456:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6161:x1875571073096192:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 197us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.513471:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 269 00000100:00100000:3.0:1788684123.525560:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684123.526460:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073096320 00000100:00100000:0.0:1788684123.526473:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073096320 00000100:00100000:0.0:1788684123.526563:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 270 00000100:00100000:0.0:1788684123.526574:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6161:x1875571073096320:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.526730:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6161:x1875571073096320:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 158us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.526738:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 270 00000100:00100000:2.0:1788684123.535101:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684123.536990:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073096448 00000100:00100000:0.0:1788684123.537003:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073096448 00000100:00100000:0.0:1788684123.539450:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 271 00000100:00100000:0.0:1788684123.539468:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6161:x1875571073096448:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684123.539606:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6161:x1875571073096448:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 144us (4512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.539614:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 271 00000100:00100000:0.0:1788684123.556014:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684123.556550:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073096576 00000100:00100000:3.0:1788684123.556560:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073096576 00000100:00100000:3.0:1788684123.556653:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 272 00000100:00100000:3.0:1788684123.556663:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6716:x1875571073096576:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684123.556809:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6716:x1875571073096576:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 146us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684123.556817:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 272 00000100:00100000:3.0:1788684123.566697:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684123.577470:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073096704 00000100:00100000:0.0:1788684123.577480:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073096704 00000100:00100000:0.0:1788684123.577527:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 273 00000100:00100000:0.0:1788684123.577536:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6716:x1875571073096704:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788684123.577663:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:6716:x1875571073096704:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 127us (10975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684123.577671:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 273 00010000:00010000:2.0:1788684123.774272:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684124.351614:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684124.351747:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684124.351861:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684124.351895:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684124.352007:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073096832 00000100:00100000:3.0:1788684124.352020:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073096832 00000100:00100000:3.0:1788684124.352078:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 274 00000100:00100000:3.0:1788684124.352096:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2393:x1875571073096832:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684124.352194:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2393:x1875571073096832:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 99us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684124.352202:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 274 00000100:00100000:1.0:1788684124.355535:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073097216 00000100:00100000:1.0:1788684124.355556:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073097216 00000100:00100000:1.0:1788684124.355769:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:1.0:1788684124.355782:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073097216:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684124.355881:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073097216:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 102us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684124.355889:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00080000:1.0:1788684124.356018:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684124.362079:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073096960 00000100:00100000:0.0:1788684124.362131:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073096960 00000100:00080000:0.0:1788684124.362221:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684124.362302:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073097088 00000100:00100000:0.0:1788684124.362307:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073097088 00000100:00100000:0.0:1788684124.362358:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:0.0:1788684124.362389:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073096960:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684124.362498:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073096960:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 112us (10898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684124.362521:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:0.0:1788684124.362543:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:0.0:1788684124.362550:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073097088:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684124.362578:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073097088:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 29us (10681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684124.362585:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:2.0:1788684124.364437:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684124.364493:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073097344 00000100:00100000:2.0:1788684124.365600:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073097344 00000100:00100000:2.0:1788684124.365703:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:2.0:1788684124.365715:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073097344:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684124.365801:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073097344:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 89us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684124.365810:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00080000:1.0:1788684124.366273:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788684124.366286:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788684124.799150:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684125.824145:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684126.333490:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684126.333510:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085740032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684126.333566:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.333705:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085740160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684126.333731:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684126.333815:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085740032 00000100:00100000:2.0:1788684126.333821:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085740032 00000100:00100000:2.0:1788684126.333859:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085740160 00000100:00100000:2.0:1788684126.333861:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085740160 00000100:00100000:2.0:1788684126.333875:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684126.333882:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085740032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684126.333910:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684126.333947:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085740032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684126.333953:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684126.333968:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684126.333974:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085740160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684126.333981:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684126.333999:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085740160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 25us (268us total) trans 0 rc 0/0 00010000:00080000:0.0:1788684126.334090:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d30e00 x1875571085740160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684126.334106:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085740160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684126.334144:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788684126.334174:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788684126.334191:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66478f7800 x1875571085740032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684126.334202:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085740032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684126.334481:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085740544:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334510:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.334526:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085741056:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334544:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.334556:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085741568:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334602:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.334626:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788684126.334632:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085740416:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334650:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.334661:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085740928:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334676:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.334688:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085741440:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334702:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.334725:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085740544 00000100:00100000:0.0:1788684126.334729:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085740544 00000100:00100000:0.0:1788684126.334753:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788684126.334758:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085740544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334789:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085740544:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.334795:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788684126.334810:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085741056 00000100:00100000:0.0:1788684126.334813:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085741056 00000100:00100000:0.0:1788684126.334834:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085740416 00000100:00100000:0.0:1788684126.334836:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085740416 00000100:00100000:0.0:1788684126.334844:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085740928 00000100:00100000:0.0:1788684126.334846:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085740928 00000100:00100000:0.0:1788684126.334856:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788684126.334861:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085741056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334885:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085741056:12345-0@lo:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.334890:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788684126.334898:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788684126.334908:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085740416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334930:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085740416:12345-0@lo:400:kworker.0 Request processed in 22us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.334935:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788684126.334945:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788684126.334950:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085740928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.334968:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085740928:12345-0@lo:400:kworker.0 Request processed in 19us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.334973:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788684126.334986:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085741568 00000100:00100000:0.0:1788684126.334989:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085741568 00000100:00100000:0.0:1788684126.335020:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085741440 00000100:00100000:0.0:1788684126.335023:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085741440 00000100:00100000:0.0:1788684126.335039:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788684126.335044:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085741568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335069:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085741568:12345-0@lo:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.335075:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788684126.335083:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788684126.335088:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085741440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335118:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085741440:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.335124:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788684126.335149:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085740672:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335168:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.335182:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085741184:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335204:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.335393:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788684126.335402:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085740288:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335429:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.335448:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085740800:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335466:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.335480:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085741312:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335503:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.335524:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085740288 00000100:00100000:0.0:1788684126.335527:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085740288 00000100:00100000:0.0:1788684126.335552:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788684126.335558:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085740288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335654:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085740288:12345-0@lo:400:kworker.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.335662:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788684126.335689:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085740800 00000100:00100000:0.0:1788684126.335692:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085740800 00000100:00100000:0.0:1788684126.335711:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788684126.335716:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085740800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335744:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085740800:12345-0@lo:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.335750:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788684126.335767:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085740672 00000100:00100000:0.0:1788684126.335770:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085740672 00000100:00100000:0.0:1788684126.335785:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085741184 00000100:00100000:0.0:1788684126.335787:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085741184 00000100:00100000:0.0:1788684126.335798:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085741312 00000100:00100000:0.0:1788684126.335808:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085741312 00000100:00100000:0.0:1788684126.335826:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788684126.335831:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085740672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335859:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085740672:12345-0@lo:400:kworker.0 Request processed in 28us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.335864:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788684126.335874:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788684126.335880:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085741184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335904:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085741184:12345-0@lo:400:kworker.0 Request processed in 24us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.335910:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788684126.335919:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788684126.335925:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085741312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335947:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085741312:12345-0@lo:400:kworker.0 Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.335953:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788684126.335988:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085740416:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.335998:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085740928:0@lo:400:kworker.0 00000100:00080000:2.0:1788684126.336181:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684126.336186:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684126.336188:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788684126.336491:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085740288:0@lo:400:kworker.0 00000100:00100000:1.0:1788684126.336501:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085740800:0@lo:400:kworker.0 00010000:00080000:1.0:1788684126.336511:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677718e300 x1875571085741312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684126.336534:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085741312:0@lo:400:kworker.0 00000100:00100000:1.0:1788684126.336544:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085740672:0@lo:400:kworker.0 00000100:00100000:1.0:1788684126.336553:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085741184:0@lo:400:kworker.0 00010000:00080000:0.0:1788684126.336673:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677718d500 x1875571085741440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684126.336683:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085741440:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.336696:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085740544:0@lo:400:kworker.0 00010000:00080000:0.0:1788684126.336705:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677718f100 x1875571085741056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684126.336724:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085741056:0@lo:400:kworker.0 00010000:00080000:0.0:1788684126.336734:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6780033800 x1875571085741568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684126.336742:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085741568:0@lo:400:kworker.0 00000100:00100000:0.0:1788684126.845475:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684126.845493:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085741696:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788684126.845506:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684126.845556:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684126.845577:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085741696 00000100:00100000:1.0:1788684126.845585:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085741696 00000100:00100000:1.0:1788684126.845644:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788684126.845653:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085741696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684126.845685:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684126.845743:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085741696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684126.845751:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788684126.845889:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085741696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684126.846345:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684126.846356:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085741824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684126.846418:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684126.846454:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085741824 00000100:00100000:0.0:1788684126.846459:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085741824 00000100:00100000:0.0:1788684126.846489:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788684126.846495:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085741824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684126.846513:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684126.846546:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085741824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684126.846552:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788684126.846579:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664790b800 x1875571085741824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684126.846593:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085741824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684126.853665:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085741952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684126.853727:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684126.853786:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085741952 00000100:00100000:3.0:1788684126.853793:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085741952 00000100:00100000:3.0:1788684126.853831:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788684126.853839:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085741952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788684126.853859:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684126.853902:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085741952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684126.853909:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788684126.853946:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664799d500 x1875571085741952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684126.853965:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085741952:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788684127.090489:0:10673:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788684127.358289:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085742080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684127.358352:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684127.358776:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085742080 00000100:00100000:1.0:1788684127.358784:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085742080 00000100:00100000:1.0:1788684127.358834:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788684127.358843:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085742080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684127.358872:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788684127.358926:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085742080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684127.358932:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788684127.359011:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085742080:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788684127.870979:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684128.893517:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684129.466646:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684129.466689:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684129.466704:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073097472 00000100:00100000:2.0:1788684129.466714:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073097472 00000100:00100000:1.0:1788684129.466722:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684129.466743:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684129.466758:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 276 00000100:00100000:2.0:1788684129.466767:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073097472:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684129.466791:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684129.466812:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073097984 00000100:00100000:1.0:1788684129.466815:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073097984 00000100:00100000:2.0:1788684129.466826:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073097472:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684129.466833:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 276 00000100:00100000:1.0:1788684129.466853:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073097856 00000100:00100000:1.0:1788684129.466856:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073097856 00000100:00100000:1.0:1788684129.466876:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:1.0:1788684129.466882:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073097984:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684129.466908:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073097984:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684129.466914:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:1.0:1788684129.466925:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:1.0:1788684129.466931:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073097856:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684129.466950:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073097856:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 20us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684129.466956:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:1.0:1788684129.466972:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073097728 00000100:00100000:1.0:1788684129.466976:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073097728 00000100:00100000:1.0:1788684129.467016:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073097600 00000100:00100000:1.0:1788684129.467019:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073097600 00000100:00100000:1.0:1788684129.467041:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:1.0:1788684129.467047:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073097728:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684129.467080:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073097728:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684129.467081:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00100000:1.0:1788684129.467086:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:2.0:1788684129.467089:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073097600:12345-192.168.206.44@tcp:400:kworker.0 00000100:00080000:1.0:1788684129.467104:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684129.467107:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684129.467113:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073097600:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684129.467120:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00080000:1.0:1788684129.468185:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788684129.468198:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788684129.917492:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788684130.894887:0:10917:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing yml_node 00010000:00010000:0.0:1788684130.944233:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684131.453768:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085742208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684131.453836:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684131.453868:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085742592:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.453894:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085742720:0@lo:400:kworker.0 00000100:00100000:1.0:1788684131.453909:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684131.454447:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085742464:0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.457410:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085742208 00000100:00100000:3.0:1788684131.457419:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085742208 00000100:00100000:3.0:1788684131.458241:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684131.458268:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085742208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684131.458298:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684131.458342:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684131.459784:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085743104:0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.461243:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085742208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2973us (7403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684131.461255:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788684131.461293:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684131.461611:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085742336:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.461655:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684131.461685:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085742848:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.461711:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684131.461735:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085743360:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.461757:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684131.461776:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085743872:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.461796:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684131.461829:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085742592 00000100:00100000:0.0:1788684131.461836:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085742592 00000100:00100000:0.0:1788684131.461870:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085742848 00000100:00100000:0.0:1788684131.461873:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085742848 00000100:00100000:0.0:1788684131.461887:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788684131.461894:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085742592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.461938:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085742592:12345-0@lo:400:kworker.0 Request processed in 45us (8030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684131.461945:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788684131.461956:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788684131.461962:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085742848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.461990:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085742848:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684131.462009:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788684131.462537:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684131.462564:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085743616:0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.462571:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085742336 00000100:00100000:3.0:1788684131.462577:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085742336 00000100:00100000:1.0:1788684131.462587:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684131.462617:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788684131.462625:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085742336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684131.462629:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085742592:0@lo:400:kworker.0 00000100:00100000:1.0:1788684131.462647:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684131.462656:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085744000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684131.462666:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085742336:12345-0@lo:400:kworker.0 Request processed in 42us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684131.462675:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788684131.462686:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684131.462711:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085744000 00000100:00100000:3.0:1788684131.462716:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085744000 00000100:00100000:3.0:1788684131.462751:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684131.462758:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085744000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684131.462772:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684131.462811:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085744000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684131.462818:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788684131.462835:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788684131.463105:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664799d500 x1875571085744000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684131.463122:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085744000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684131.463300:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085742720 00000100:00100000:0.0:1788684131.463305:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085742720 00000100:00100000:0.0:1788684131.463382:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085743104 00000100:00100000:0.0:1788684131.463386:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085743104 00000100:00100000:2.0:1788684131.466780:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684131.471115:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085743616 00000100:00100000:3.0:1788684131.471142:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085743616 00000100:00100000:2.0:1788684131.471148:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085742976:0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.471186:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085742464 00000100:00100000:3.0:1788684131.471190:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085742464 00000100:00100000:2.0:1788684131.471218:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684131.471223:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788684131.471234:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085742720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684131.471241:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085743488:0@lo:400:kworker.0 00000100:00100000:2.0:1788684131.471278:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684131.471301:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085742720:12345-0@lo:400:kworker.0 Request processed in 69us (12957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684131.471309:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788684131.471323:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085742976 00000100:00100000:3.0:1788684131.471328:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085743488 00000100:00100000:2.0:1788684131.471329:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085742976 00000100:00100000:3.0:1788684131.471334:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085743488 00000100:00100000:3.0:1788684131.471353:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788684131.471359:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085743104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.471415:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085743104:12345-0@lo:400:kworker.0 Request processed in 55us (8878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684131.471422:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788684131.471446:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788684131.471636:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788684131.471646:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085743616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.471647:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085742464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684131.471699:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085743616:12345-0@lo:400:kworker.0 Request processed in 245us (9111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684131.471708:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085742464:12345-0@lo:400:kworker.0 Request processed in 64us (4932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684131.471708:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788684131.471721:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788684131.471733:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788684131.471745:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788684131.471746:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085743488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.471758:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085742976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684131.471786:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085743488:12345-0@lo:400:kworker.0 Request processed in 45us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684131.471794:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788684131.471799:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085742976:12345-0@lo:400:kworker.0 Request processed in 44us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684131.471807:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788684131.471832:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684131.471836:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684131.471837:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085742464:0@lo:400:kworker.0 00000100:00100000:2.0:1788684131.471850:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085742976:0@lo:400:kworker.0 00010000:00080000:3.0:1788684131.471870:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a6d80 x1875571085743104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684131.471883:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085743104:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.471939:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085743360 00000100:00100000:0.0:1788684131.471945:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085743360 00000100:00100000:0.0:1788684131.471974:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085743872 00000100:00100000:0.0:1788684131.471977:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085743872 00000100:00100000:0.0:1788684131.472003:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788684131.472010:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085743360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684131.472517:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085743488:0@lo:400:kworker.0 00010000:00080000:3.0:1788684131.472549:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a7480 x1875571085743616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684131.472552:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788684131.472565:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085743872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.472566:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085743616:0@lo:400:kworker.0 00000100:00080000:3.0:1788684131.472595:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684131.472612:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085743872:12345-0@lo:400:kworker.0 Request processed in 49us (10814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684131.472620:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788684131.472681:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085743360:12345-0@lo:400:kworker.0 Request processed in 671us (10921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684131.472689:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788684131.472726:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085742336:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.472740:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085742848:0@lo:400:kworker.0 00010000:00080000:0.0:1788684131.472752:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5500 x1875571085743360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684131.472762:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085743360:0@lo:400:kworker.0 00010000:00080000:0.0:1788684131.472773:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5f80 x1875571085743872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684131.472782:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085743872:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.472827:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085742720:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.472836:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085743232:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.472874:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684131.472900:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085743744:0@lo:400:kworker.0 00000100:00100000:0.0:1788684131.472963:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788684131.473112:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647909500 x1875571085742208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684131.473137:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085742208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684131.473251:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085743232 00000100:00100000:3.0:1788684131.473256:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085743232 00000100:00100000:3.0:1788684131.473290:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085743744 00000100:00100000:3.0:1788684131.473294:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085743744 00000100:00100000:3.0:1788684131.473324:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684131.473331:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085743232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.473396:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085743232:12345-0@lo:400:kworker.0 Request processed in 65us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684131.473405:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684131.473417:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684131.473427:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085743744:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788684131.473567:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a6300 x1875571085743232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684131.473577:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085743232:0@lo:400:kworker.0 00010000:00080000:0.0:1788684131.473593:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a4000 x1875571085743744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684131.473601:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085743744:0@lo:400:kworker.0 00000100:00100000:3.0:1788684131.473646:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085743744:12345-0@lo:400:kworker.0 Request processed in 35us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684131.473654:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788684131.473676:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684131.965610:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684131.965716:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085744128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684131.965809:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684131.965822:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085744256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684131.965867:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684131.965899:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085744384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684131.965976:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684131.966027:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684131.966046:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085744384 00000100:00100000:0.0:1788684131.966067:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085744384 00000100:00100000:1.0:1788684131.966238:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085744128 00000100:00100000:1.0:1788684131.966245:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085744128 00000100:00100000:1.0:1788684131.966291:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085744256 00000100:00100000:1.0:1788684131.966295:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085744256 00000100:00100000:1.0:1788684131.966312:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788684131.966322:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085744128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684131.966360:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684131.966539:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788684131.966549:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085744384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788684131.966576:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684131.966631:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085744128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 308us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684131.966632:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085744384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684131.966644:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684131.966655:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788684131.966669:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684131.966679:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085744256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684131.966690:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684131.966729:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085744256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684131.966746:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788684131.966879:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664799d500 x1875571085744256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684131.966908:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085744256:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788684131.967027:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647909500 x1875571085744128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684131.967105:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085744128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684131.967143:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085744384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684132.478047:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684132.478075:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085744512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684132.478244:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684132.478398:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085744512 00000100:00100000:1.0:1788684132.478408:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085744512 00000100:00100000:1.0:1788684132.482697:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788684132.482727:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085744512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684132.482789:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788684132.483121:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085744512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 409us (4876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684132.483575:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788684132.483917:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085744512:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684132.990788:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684134.014047:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684134.602475:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684134.602610:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684134.602646:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684134.602668:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684134.602693:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684134.602728:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073098112 00000100:00100000:3.0:1788684134.602740:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073098112 00000100:00100000:3.0:1788684134.602800:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 278 00000100:00100000:3.0:1788684134.602812:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2393:x1875571073098112:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684134.602894:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2393:x1875571073098112:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684134.602903:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 278 00000100:00100000:3.0:1788684134.602962:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073098368 00000100:00100000:3.0:1788684134.602968:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073098368 00000100:00100000:3.0:1788684134.603005:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073098240 00000100:00100000:3.0:1788684134.603008:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073098240 00000100:00100000:3.0:1788684134.603035:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:3.0:1788684134.603041:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073098368:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684134.603089:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073098368:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 48us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684134.603109:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:3.0:1788684134.603123:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:3.0:1788684134.603129:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073098240:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684134.603155:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073098240:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684134.603160:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:3.0:1788684134.603193:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073098496 00000100:00100000:3.0:1788684134.603197:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073098496 00000100:00100000:3.0:1788684134.603223:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073098624 00000100:00100000:3.0:1788684134.603226:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073098624 00000100:00100000:3.0:1788684134.603244:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1788684134.603251:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2389:x1875571073098496:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:3.0:1788684134.603300:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac30d 00000100:00080000:3.0:1788684134.603312:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8d664742a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684134.603388:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788684134.603534:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+2:2389:x1875571073098496:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 282us (11218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684134.603541:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1788684134.603553:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1788684134.603559:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2389:x1875571073098624:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:3.0:1788684134.603572:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac314 00000100:00080000:3.0:1788684134.603579:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8d664742c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684134.603601:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788684134.603673:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+2:2389:x1875571073098624:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 114us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684134.603690:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00080000:3.0:1788684134.603838:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684134.603843:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684134.603845:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684134.603848:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788684134.603870:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684134.603875:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788684134.879041:0:11100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:1.0:1788684135.039751:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684136.062313:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684136.574342:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788684136.574394:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085744640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684136.574705:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.574786:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085744640 00000100:00100000:3.0:1788684136.574796:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085744640 00000100:00100000:3.0:1788684136.574859:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788684136.574869:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085744640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684136.574905:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684136.574956:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085744640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684136.574964:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788684136.574989:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788684136.575023:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664799d500 x1875571085744640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684136.575536:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085744640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684136.579793:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085744768:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.579891:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.579956:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085745280:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580002:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580024:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085745792:0@lo:400:kworker.0 00000100:00100000:0.0:1788684136.580040:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085745280 00000100:00100000:3.0:1788684136.580049:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684136.580052:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085745280 00000100:00100000:3.0:1788684136.580078:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085746304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684136.580104:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580124:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788684136.580130:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085744896:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580180:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580201:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085745408:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580226:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580245:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085745920:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580268:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580299:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085745024:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580324:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580343:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085745536:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580395:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580408:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085746048:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580436:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580455:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788684136.580462:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085745152:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580486:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580498:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085745664:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580519:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580539:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085746176:0@lo:400:kworker.0 00000100:00100000:0.0:1788684136.580544:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788684136.580563:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085745280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580580:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684136.580617:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085744768 00000100:00100000:3.0:1788684136.580623:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085744768 00000100:00100000:0.0:1788684136.580645:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085745280:12345-0@lo:400:kworker.0 Request processed in 86us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684136.580653:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788684136.580661:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788684136.580671:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085744768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684136.580675:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085745024 00000100:00100000:0.0:1788684136.580680:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085745024 00000100:00100000:0.0:1788684136.580704:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788684136.580712:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085745024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.580716:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085744768:12345-0@lo:400:kworker.0 Request processed in 46us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684136.580725:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788684136.580765:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085745792 00000100:00100000:0.0:1788684136.580765:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085745024:12345-0@lo:400:kworker.0 Request processed in 52us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684136.580771:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085745792 00000100:00100000:0.0:1788684136.580777:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788684136.580810:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085744896 00000100:00100000:3.0:1788684136.580813:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085744896 00000100:00100000:3.0:1788684136.580826:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085745408 00000100:00100000:3.0:1788684136.580828:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085745408 00000100:00100000:3.0:1788684136.580841:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085745920 00000100:00100000:3.0:1788684136.580843:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085745920 00000100:00100000:3.0:1788684136.580855:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085745536 00000100:00100000:3.0:1788684136.580857:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085745536 00000100:00100000:3.0:1788684136.580866:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085745152 00000100:00100000:3.0:1788684136.580869:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085745152 00000100:00100000:3.0:1788684136.580880:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788684136.580885:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085745792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684136.582063:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085744768:0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.582968:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085745792:12345-0@lo:400:kworker.0 Request processed in 2075us (2911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684136.582983:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788684136.583028:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788684136.583039:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085744896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.583096:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085744896:12345-0@lo:400:kworker.0 Request processed in 61us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684136.583115:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788684136.583132:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788684136.583141:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085745408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.583188:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085745408:12345-0@lo:400:kworker.0 Request processed in 49us (2962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684136.583194:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788684136.583208:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788684136.583217:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085745920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.583255:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085745920:12345-0@lo:400:kworker.0 Request processed in 40us (2985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684136.583261:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788684136.583796:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085746048 00000100:00100000:2.0:1788684136.583809:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085746048 00000100:00100000:2.0:1788684136.584074:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085745664 00000100:00100000:2.0:1788684136.584079:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085745664 00000100:00100000:2.0:1788684136.584100:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085746176 00000100:00100000:2.0:1788684136.584104:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085746176 00000100:00100000:2.0:1788684136.584120:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788684136.584129:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677e51e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085746048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684136.584203:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677e51e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085746048:12345-0@lo:400:kworker.0 Request processed in 75us (3765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684136.584211:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788684136.584537:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788684136.584549:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085745536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684136.584599:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085745536:12345-0@lo:400:kworker.0 Request processed in 53us (4202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684136.584606:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788684136.584673:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788684136.584681:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085745664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684136.584718:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085745664:12345-0@lo:400:kworker.0 Request processed in 38us (4197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684136.584724:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788684136.584739:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788684136.584746:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085746176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684136.584774:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085746176:12345-0@lo:400:kworker.0 Request processed in 29us (4195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684136.584781:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788684136.584807:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788684136.584815:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085745152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684136.584943:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085745152:12345-0@lo:400:kworker.0 Request processed in 129us (4456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684136.585018:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788684136.585055:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085746304 00000100:00100000:2.0:1788684136.585061:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085746304 00000100:00100000:2.0:1788684136.585094:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788684136.585101:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085746304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684136.585117:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684136.585155:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085746304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (5050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684136.585162:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788684136.585564:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085745024:0@lo:400:kworker.0 00010000:00080000:1.0:1788684136.585588:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664799fb80 x1875571085745536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684136.585600:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085745536:0@lo:400:kworker.0 00010000:00080000:1.0:1788684136.585618:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677709b480 x1875571085746048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788684136.585621:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684136.585630:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684136.585632:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085746048:0@lo:400:kworker.0 00000100:00080000:2.0:1788684136.585636:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684136.585641:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684136.585680:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085745152:0@lo:400:kworker.0 00010000:00080000:1.0:1788684136.585695:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664799ed80 x1875571085745664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684136.585704:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085745664:0@lo:400:kworker.0 00010000:00080000:1.0:1788684136.585718:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677709a680 x1875571085746176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684136.585743:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085746176:0@lo:400:kworker.0 00000100:00100000:0.0:1788684136.586129:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085745280:0@lo:400:kworker.0 00000100:00100000:0.0:1788684136.586570:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085745792:0@lo:400:kworker.0 00000100:00100000:0.0:1788684136.586614:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085744896:0@lo:400:kworker.0 00000100:00100000:0.0:1788684136.586627:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085745408:0@lo:400:kworker.0 00010000:00080000:0.0:1788684136.586642:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa6a680 x1875571085745920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684136.586654:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085745920:0@lo:400:kworker.0 00010000:00080000:0.0:1788684136.586681:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e2680 x1875571085746304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684136.586700:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085746304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684137.085799:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085746560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684137.085813:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085746432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684137.089694:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684137.089796:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684137.089812:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085746688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684137.089864:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684137.089978:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085746688 00000100:00100000:1.0:1788684137.089988:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085746688 00000100:00100000:1.0:1788684137.090045:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788684137.090056:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085746688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684137.090104:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684137.090158:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085746688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684137.090177:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788684137.091859:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e2680 x1875571085746688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684137.091900:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085746688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684137.093013:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085746560 00000100:00100000:0.0:1788684137.093029:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085746560 00000100:00100000:0.0:1788684137.093091:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788684137.093103:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085746560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788684137.093149:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788684137.093260:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085746560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684137.093267:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788684137.093341:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085746560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684137.093560:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684137.093903:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684137.095477:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085746432 00000100:00100000:0.0:1788684137.095494:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085746432 00000100:00100000:0.0:1788684137.095570:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684137.095582:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085746432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684137.095685:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684137.095838:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085746432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 258us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684137.095847:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788684137.097728:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647564a80 x1875571085746432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684137.097761:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085746432:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788684137.224691:0:11198:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:2.0:1788684137.600574:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684137.600977:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085746816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684137.601148:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684137.601328:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085746816 00000100:00100000:1.0:1788684137.601343:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085746816 00000100:00100000:1.0:1788684137.601449:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788684137.601459:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085746816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684137.601504:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788684137.601601:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085746816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684137.601631:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788684137.601643:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085746816:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788684138.110057:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684139.133766:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684139.706211:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684139.706251:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684139.706283:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684139.706417:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073099008 00000100:00100000:1.0:1788684139.706427:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073099008 00000100:00100000:1.0:1788684139.706481:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073098880 00000100:00100000:1.0:1788684139.706485:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073098880 00000100:00100000:1.0:1788684139.706508:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:1.0:1788684139.706523:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073099008:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684139.706589:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073099008:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 73us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684139.706597:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:1.0:1788684139.706611:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 90 00000100:00100000:1.0:1788684139.706617:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073098880:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684139.706638:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073098880:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 21us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684139.706643:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 90 00000100:00080000:0.0:1788684139.706839:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684139.706854:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684139.707319:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073098752 00000100:00100000:3.0:1788684139.707326:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073098752 00000100:00100000:3.0:1788684139.707400:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 280 00000100:00100000:3.0:1788684139.707409:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2392:x1875571073098752:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684139.707457:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2392:x1875571073098752:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 49us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684139.707464:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 280 00000001:02000400:1.0:1788684139.922640:0:11295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:3.0:1788684140.158082:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788684140.158994:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:2.0:1788684140.159001:0:8406:0:(genops.c:885:class_export_put()) final put ffff8d677cefe800/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:1.0:1788684140.159071:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cefe800/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e for lustre-OST0000 00000020:00000080:1.0:1788684140.159124:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664742a000 for lustre-OST0000 00000001:00100000:3.0:1788684140.159177:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:3.0:1788684140.159182:0:9488:0:(genops.c:885:class_export_put()) final put ffff8d664742f000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:1.0:1788684140.159238:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664742f000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e for lustre-OST0001 00000020:00000080:1.0:1788684140.159266:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664742c800 for lustre-OST0001 00010000:00010000:0.0:1788684141.188921:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788684141.390808:0:11343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 04:42:20 EDT 2026 00000100:00100000:2.0:1788684141.693594:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085746944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684141.693670:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684141.693787:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085746944 00000100:00100000:0.0:1788684141.693794:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085746944 00000100:00100000:0.0:1788684141.693845:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788684141.693854:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085746944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788684141.693880:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684141.694090:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085746944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 237us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684141.694097:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788684141.694131:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e2300 x1875571085746944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684141.694159:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085746944:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788684141.694215:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684141.695996:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085747200:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.696034:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085747072:0@lo:400:kworker.0 00000100:00100000:2.0:1788684141.696067:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684141.696083:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684141.696127:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085747712:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.696129:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085747584:0@lo:400:kworker.0 00000100:00100000:3.0:1788684141.696599:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085747328:0@lo:400:kworker.0 00000100:00100000:0.0:1788684141.697256:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085747456:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.703858:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684141.704305:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085748096:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.704340:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684141.704380:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684141.704388:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085748224:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.704411:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684141.704475:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085747200 00000100:00100000:1.0:1788684141.704482:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085747200 00000100:00100000:1.0:1788684141.704528:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085748096 00000100:00100000:1.0:1788684141.704531:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085748096 00000100:00100000:1.0:1788684141.704554:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085748224 00000100:00100000:1.0:1788684141.704557:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085748224 00000100:00100000:1.0:1788684141.704571:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684141.704578:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085747200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.704624:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085747200:12345-0@lo:400:kworker.0 Request processed in 45us (8558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684141.704630:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684141.704645:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788684141.704650:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085748096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.704674:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085748096:12345-0@lo:400:kworker.0 Request processed in 24us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684141.704679:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788684141.704689:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788684141.704695:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085748224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.704719:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085748224:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684141.704725:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788684141.704756:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684141.704760:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684141.704771:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085748608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684141.704801:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788684141.704834:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e0a80 x1875571085748224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684141.704846:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085748224:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.704857:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085748096:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.704884:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085748608 00000100:00100000:1.0:1788684141.704887:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085748608 00000100:00100000:1.0:1788684141.705022:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788684141.705030:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085748608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684141.705048:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684141.705083:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085748608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684141.705089:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788684141.705104:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788684141.705124:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677718f800 x1875571085748608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684141.705137:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085748608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684141.705184:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085747584 00000100:00100000:1.0:1788684141.705187:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085747584 00000100:00100000:1.0:1788684141.705212:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788684141.705218:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085747584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.705253:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085747584:12345-0@lo:400:kworker.0 Request processed in 36us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684141.705265:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788684141.705449:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085747584:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.705488:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085747072 00000100:00100000:1.0:1788684141.705492:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085747072 00000100:00100000:1.0:1788684141.705527:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788684141.705534:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085747072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.705569:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085747072:12345-0@lo:400:kworker.0 Request processed in 36us (9488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684141.705575:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788684141.705604:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085747072:0@lo:400:kworker.0 00000100:00100000:2.0:1788684141.705972:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684141.706023:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085747200:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.706767:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085747712 00000100:00100000:1.0:1788684141.706775:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085747712 00000100:00100000:1.0:1788684141.706832:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788684141.706841:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085747712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.706907:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085747712:12345-0@lo:400:kworker.0 Request processed in 67us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684141.706914:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788684141.707235:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684141.707274:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085747712:0@lo:400:kworker.0 00000100:00100000:3.0:1788684141.710280:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684141.710280:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684141.710321:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085747968:0@lo:400:kworker.0 00000100:00100000:3.0:1788684141.710324:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085747840:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.710400:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085747328 00000100:00100000:1.0:1788684141.710407:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085747328 00000100:00100000:1.0:1788684141.710527:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788684141.710537:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085747328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684141.710633:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085747456 00000100:00100000:2.0:1788684141.710638:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085747456 00000100:00100000:2.0:1788684141.710667:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788684141.710673:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085747456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684141.713011:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684141.713078:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085747968 00000100:00100000:0.0:1788684141.713086:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085747968 00000100:00100000:0.0:1788684141.713129:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684141.713138:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085747968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684141.713208:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085747968:12345-0@lo:400:kworker.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684141.713215:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788684141.713856:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e0000 x1875571085747968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684141.713890:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085747968:0@lo:400:kworker.0 00000100:00100000:0.0:1788684141.713902:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085748480:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.714015:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085747328:12345-0@lo:400:kworker.0 Request processed in 3478us (3738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684141.714025:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788684141.715340:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085747456:12345-0@lo:400:kworker.0 Request processed in 4662us (5060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684141.715351:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788684141.722455:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684141.722518:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085748352:0@lo:400:kworker.0 00000100:00100000:3.0:1788684141.722574:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684141.722621:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085747328:0@lo:400:kworker.0 00000100:00100000:2.0:1788684141.722964:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085748352 00000100:00100000:2.0:1788684141.722971:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085748352 00000100:00100000:2.0:1788684141.723041:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788684141.723051:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085748352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684141.723110:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085748352:12345-0@lo:400:kworker.0 Request processed in 61us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684141.723119:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684141.723136:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684141.723165:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085748480 00000100:00100000:2.0:1788684141.723170:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085748480 00000100:00080000:3.0:1788684141.723189:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684141.723207:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684141.723209:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085747456:0@lo:400:kworker.0 00010000:00080000:3.0:1788684141.723212:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e0700 x1875571085748352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684141.723225:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085748352:0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.723277:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085747840 00000100:00100000:1.0:1788684141.723287:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085747840 00000100:00080000:3.0:1788684141.723333:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788684141.723334:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788684141.723344:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085747840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684141.723404:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085747840:12345-0@lo:400:kworker.0 Request processed in 62us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684141.723410:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1788684141.723459:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e0380 x1875571085747840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684141.723468:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085747840:0@lo:400:kworker.0 00000100:00100000:2.0:1788684141.723558:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085748480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684141.723591:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085748480:12345-0@lo:400:kworker.0 Request processed in 363us (457us total) trans 0 rc 0/0 00010000:00080000:1.0:1788684141.723643:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e1c00 x1875571085748480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684141.723653:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085748480:0@lo:400:kworker.0 00000100:00100000:2.0:1788684141.726799:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788684142.205535:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684142.205546:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684142.205555:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085748864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684142.205560:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085748736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684142.206028:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684142.206038:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085748992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684142.208291:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684142.208597:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085748864 00000100:00100000:2.0:1788684142.208606:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085748864 00000100:00100000:2.0:1788684142.208656:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788684142.208665:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085748864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684142.208697:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788684142.208749:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085748864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684142.208756:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788684142.208874:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085748864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684142.209499:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684142.209548:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684142.209601:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085748736 00000100:00100000:1.0:1788684142.209606:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085748736 00000100:00100000:2.0:1788684142.209642:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684142.209648:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085748992 00000100:00100000:1.0:1788684142.209653:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085748992 00000100:00100000:1.0:1788684142.209675:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788684142.209683:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085748736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684142.209704:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684142.209754:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085748736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684142.209761:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788684142.209804:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e0000 x1875571085748736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684142.209820:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085748736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684142.209993:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788684142.210003:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085748992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684142.210104:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684142.210352:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085748992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 351us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684142.210359:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788684142.210514:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647566680 x1875571085748992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684142.210529:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085748992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684142.730889:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684142.743294:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085749120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684142.743385:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684142.743460:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085749120 00000100:00100000:3.0:1788684142.743468:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085749120 00000100:00100000:3.0:1788684142.743512:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788684142.743520:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085749120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684142.743555:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788684142.743601:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085749120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684142.743607:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788684142.743650:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085749120:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684143.231624:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684144.253977:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684144.823951:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684144.824008:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684144.824050:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684144.824221:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073099136 00000100:00100000:3.0:1788684144.824230:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073099136 00000100:00100000:3.0:1788684144.824288:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 282 00000100:00100000:3.0:1788684144.824299:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073099136:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684144.824416:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073099136:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 68us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684144.824425:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 282 00000100:00100000:2.0:1788684144.825179:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073099264 00000100:00100000:2.0:1788684144.825186:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073099264 00000100:00100000:2.0:1788684144.825236:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073099392 00000100:00100000:2.0:1788684144.825239:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073099392 00000100:00100000:2.0:1788684144.825262:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:2.0:1788684144.825269:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073099264:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684144.825311:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073099264:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 43us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684144.825318:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:2.0:1788684144.825345:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:2.0:1788684144.825351:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073099392:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684144.825407:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073099392:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 56us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684144.825412:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00080000:3.0:1788684144.825702:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684144.825706:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788684145.279253:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684146.303253:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684146.814851:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085749248:0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.814929:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684146.814971:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085749760:0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.814997:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684146.815017:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085750272:0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815037:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684146.815060:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788684146.815066:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085749632:0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815093:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684146.815110:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085750144:0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815145:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684146.815176:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085749248 00000100:00100000:3.0:1788684146.815183:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085749248 00000100:00100000:3.0:1788684146.815224:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788684146.815233:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085749248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815277:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085749248:12345-0@lo:400:kworker.0 Request processed in 45us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684146.815284:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788684146.815312:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085749760 00000100:00100000:3.0:1788684146.815315:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085749760 00000100:00100000:3.0:1788684146.815338:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788684146.815344:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085749760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815397:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085749760:12345-0@lo:400:kworker.0 Request processed in 53us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684146.815404:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788684146.815421:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085750272 00000100:00100000:3.0:1788684146.815424:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085750272 00000100:00100000:3.0:1788684146.815461:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085750144 00000100:00100000:3.0:1788684146.815464:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085750144 00000100:00100000:3.0:1788684146.815482:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788684146.815488:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085750272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815517:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085750272:12345-0@lo:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684146.815525:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788684146.815537:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788684146.815543:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085750144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815565:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085750144:12345-0@lo:400:kworker.0 Request processed in 22us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684146.815570:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788684146.815586:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085749632 00000100:00100000:3.0:1788684146.815589:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085749632 00000100:00100000:3.0:1788684146.815611:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788684146.815616:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085749632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815641:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085749632:12345-0@lo:400:kworker.0 Request processed in 25us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684146.815647:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788684146.815668:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684146.815702:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085749632:0@lo:400:kworker.0 00010000:00080000:3.0:1788684146.815715:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e0700 x1875571085750144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684146.815725:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085750144:0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815874:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085749248:0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.815893:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085749760:0@lo:400:kworker.0 00010000:00080000:3.0:1788684146.815903:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e1f80 x1875571085750272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684146.815912:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085750272:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.816133:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085749376:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.816168:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.816191:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085749888:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.816216:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.816240:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085750400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684146.816268:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.816285:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085750912:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.816310:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.816328:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788684146.816335:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085749504:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.816387:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.816404:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085750016:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.816423:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.816437:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085750528:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.816455:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.816476:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085749376 00000100:00100000:0.0:1788684146.816481:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085749376 00000100:00100000:0.0:1788684146.816500:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085749888 00000100:00100000:0.0:1788684146.816503:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085749888 00000100:00100000:0.0:1788684146.816518:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085750016 00000100:00100000:0.0:1788684146.816521:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085750016 00000100:00100000:0.0:1788684146.816530:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085750528 00000100:00100000:0.0:1788684146.816532:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085750528 00000100:00100000:0.0:1788684146.816547:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788684146.816554:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085749376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.816594:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085749376:12345-0@lo:400:kworker.0 Request processed in 41us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684146.816601:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788684146.816616:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788684146.816622:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085749888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.816848:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085749504 00000100:00100000:3.0:1788684146.816852:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085749504 00000100:00100000:3.0:1788684146.816878:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788684146.816884:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085749504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.816914:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085749504:12345-0@lo:400:kworker.0 Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684146.816930:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788684146.816952:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788684146.816959:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085750016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.817229:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085749888:12345-0@lo:400:kworker.0 Request processed in 607us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684146.817236:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788684146.817249:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788684146.817255:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085750528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.817281:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085750528:12345-0@lo:400:kworker.0 Request processed in 27us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684146.817296:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788684146.817312:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085750400 00000100:00100000:0.0:1788684146.817315:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085750400 00000100:00100000:0.0:1788684146.820131:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684146.820153:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085750400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788684146.820184:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684146.820249:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085750400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (3980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684146.820256:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684146.820308:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085749504:0@lo:400:kworker.0 00010000:00080000:0.0:1788684146.820323:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e0380 x1875571085750016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684146.820334:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085750016:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.820345:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085750528:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.820358:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085749376:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.820384:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085749888:0@lo:400:kworker.0 00010000:00080000:0.0:1788684146.820395:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647567100 x1875571085750400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684146.820410:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085750400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684146.823128:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085750656:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.823199:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.823243:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684146.823263:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085750784:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.823287:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.823330:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085750656 00000100:00100000:0.0:1788684146.823337:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085750656 00000100:00100000:0.0:1788684146.823393:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788684146.823402:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085750656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.823449:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085750656:12345-0@lo:400:kworker.0 Request processed in 47us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684146.823456:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1788684146.823492:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647744a80 x1875571085750656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684146.823507:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085750656:0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.823720:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085750016:12345-0@lo:400:kworker.0 Request processed in 6759us (7293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684146.824281:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788684146.824313:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085750912 00000100:00100000:3.0:1788684146.824318:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085750912 00000100:00100000:3.0:1788684146.824350:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085750784 00000100:00100000:3.0:1788684146.824353:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085750784 00000100:00100000:3.0:1788684146.824397:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788684146.824404:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085750912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.824453:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085750912:12345-0@lo:400:kworker.0 Request processed in 50us (8142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684146.824460:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788684146.824483:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788684146.824489:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085750784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684146.824522:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085750784:12345-0@lo:400:kworker.0 Request processed in 33us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684146.824529:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788684146.824551:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684146.824555:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684146.824558:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788684146.824877:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647744700 x1875571085750784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684146.824889:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085750784:0@lo:400:kworker.0 00010000:00080000:0.0:1788684146.824915:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647745c00 x1875571085750912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684146.824924:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085750912:0@lo:400:kworker.0 00000100:00100000:0.0:1788684146.824933:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684146.824939:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085751040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684146.824967:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684146.824994:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085751040 00000100:00100000:0.0:1788684146.824998:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085751040 00000100:00100000:0.0:1788684146.825017:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788684146.825023:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085751040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684146.825045:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684146.825080:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085751040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684146.825087:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788684146.825111:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647744a80 x1875571085751040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684146.825445:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085751040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684147.325540:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085751168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684147.325618:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684147.325707:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085751168 00000100:00100000:1.0:1788684147.325715:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085751168 00000100:00100000:1.0:1788684147.325760:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788684147.325769:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085751168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684147.325803:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684147.325851:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085751168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684147.325858:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788684147.325901:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085751168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684147.326214:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085751296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684147.326244:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684147.326310:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085751296 00000100:00100000:2.0:1788684147.326316:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085751296 00000100:00100000:2.0:1788684147.326356:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684147.326384:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085751296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684147.326404:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684147.326441:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085751296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684147.326449:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788684147.326481:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5880 x1875571085751296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684147.326497:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085751296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684147.326644:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085751424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684147.326674:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684147.326708:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085751424 00000100:00100000:2.0:1788684147.326713:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085751424 00000100:00100000:2.0:1788684147.326743:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788684147.326751:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085751424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684147.326761:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684147.326791:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085751424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684147.326798:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788684147.326926:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647744a80 x1875571085751424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684147.326940:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085751424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788684147.332616:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684147.837559:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684147.842272:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085751552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684147.842422:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684147.842986:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085751552 00000100:00100000:3.0:1788684147.842994:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085751552 00000100:00100000:3.0:1788684147.843050:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788684147.843059:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085751552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684147.843093:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788684147.843162:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085751552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684147.843169:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788684147.843329:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085751552:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684148.349588:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684149.375687:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684149.950197:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684149.950249:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684149.950341:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684149.950447:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073099520 00000100:00100000:2.0:1788684149.950460:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073099520 00000100:00100000:2.0:1788684149.950539:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 284 00000100:00100000:2.0:1788684149.950551:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073099520:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684149.950650:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073099520:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 101us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684149.950659:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 284 00000100:00100000:3.0:1788684149.952015:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073099648 00000100:00100000:3.0:1788684149.952032:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073099648 00000100:00100000:3.0:1788684149.952127:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073099776 00000100:00100000:3.0:1788684149.952131:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073099776 00000100:00100000:3.0:1788684149.952163:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 105 00000100:00100000:3.0:1788684149.952173:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073099648:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684149.952245:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073099648:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 74us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684149.952252:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 105 00000100:00100000:3.0:1788684149.952270:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00100000:3.0:1788684149.952291:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073099776:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684149.952315:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073099776:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684149.952321:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00080000:2.0:1788684149.952753:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684149.952759:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788684150.398547:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684151.425576:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684151.933637:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684151.933667:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085751680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684151.933755:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684151.936438:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085751680 00000100:00100000:2.0:1788684151.936457:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085751680 00000100:00100000:2.0:1788684151.936553:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788684151.936565:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085751680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684151.936617:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684151.936716:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085751680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684151.936724:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788684151.936796:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5500 x1875571085751680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684151.936820:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085751680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788684151.937376:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684151.940434:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085751808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684151.940533:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684151.941191:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085751808 00000100:00100000:0.0:1788684151.941202:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085751808 00000100:00100000:0.0:1788684151.941285:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788684151.941296:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085751808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684151.941325:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684151.941483:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085751808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684151.941491:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788684151.941547:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647747480 x1875571085751808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684151.941570:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085751808:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788684151.941707:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684151.942021:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085752192:0@lo:400:kworker.0 00000100:00100000:2.0:1788684151.942072:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684151.942118:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085752704:0@lo:400:kworker.0 00000100:00100000:2.0:1788684151.942145:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684151.942172:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085753216:0@lo:400:kworker.0 00000100:00100000:2.0:1788684151.942197:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684151.942221:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788684151.942226:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085752320:0@lo:400:kworker.0 00000100:00100000:2.0:1788684151.942247:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684151.942275:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085752832:0@lo:400:kworker.0 00000100:00100000:2.0:1788684151.942297:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684151.942332:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085752192 00000100:00100000:2.0:1788684151.942338:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085752192 00000100:00100000:2.0:1788684151.942403:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788684151.942413:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085752192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684151.942460:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085752192:12345-0@lo:400:kworker.0 Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684151.942468:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788684151.942500:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085752192:0@lo:400:kworker.0 00000100:00100000:0.0:1788684151.942754:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085751936:0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.942862:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085752064:0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.942897:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684151.942928:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085752576:0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.942951:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684151.942962:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085753088:0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.942984:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684151.943019:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085752704 00000100:00100000:3.0:1788684151.943023:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085752704 00000100:00100000:3.0:1788684151.943056:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085752320 00000100:00100000:3.0:1788684151.943059:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085752320 00000100:00100000:3.0:1788684151.943073:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085752832 00000100:00100000:3.0:1788684151.943075:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085752832 00000100:00100000:3.0:1788684151.943101:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085752064 00000100:00100000:3.0:1788684151.943104:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085752064 00000100:00100000:3.0:1788684151.943116:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085752576 00000100:00100000:3.0:1788684151.943118:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085752576 00000100:00100000:3.0:1788684151.943136:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788684151.943142:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085752704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.943181:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085752704:12345-0@lo:400:kworker.0 Request processed in 38us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684151.943188:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788684151.943214:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788684151.943219:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085752320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.943248:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085752320:12345-0@lo:400:kworker.0 Request processed in 29us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684151.943253:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788684151.943263:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788684151.943269:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085752832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.943294:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085752832:12345-0@lo:400:kworker.0 Request processed in 26us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684151.943300:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788684151.943311:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788684151.943317:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085752064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.943349:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085752064:12345-0@lo:400:kworker.0 Request processed in 33us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684151.943402:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788684151.943414:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788684151.943420:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085752576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.943447:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085752576:12345-0@lo:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684151.943452:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788684151.943472:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085753216 00000100:00100000:3.0:1788684151.943476:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085753216 00000100:00100000:3.0:1788684151.943503:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085753088 00000100:00100000:3.0:1788684151.943505:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085753088 00000100:00100000:3.0:1788684151.943523:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788684151.943529:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085753216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.943571:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085753216:12345-0@lo:400:kworker.0 Request processed in 42us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684151.943577:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788684151.943588:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788684151.943593:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085753088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684151.944914:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684151.944972:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085752448:0@lo:400:kworker.0 00000100:00100000:0.0:1788684151.945001:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684151.945026:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085752960:0@lo:400:kworker.0 00000100:00100000:0.0:1788684151.945050:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684151.945199:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085753088:12345-0@lo:400:kworker.0 Request processed in 1602us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684151.945209:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788684151.945242:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085752960 00000100:00100000:3.0:1788684151.945249:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085752960 00000100:00100000:3.0:1788684151.945284:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788684151.945292:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085752960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684151.945428:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085752320:0@lo:400:kworker.0 00000100:00100000:2.0:1788684151.945443:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085752832:0@lo:400:kworker.0 00010000:00080000:2.0:1788684151.945460:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa81500 x1875571085752704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684151.945472:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085752704:0@lo:400:kworker.0 00010000:00080000:2.0:1788684151.945484:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa6a680 x1875571085753216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684151.945492:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085753216:0@lo:400:kworker.0 00000100:00100000:2.0:1788684151.945558:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085752448 00000100:00100000:2.0:1788684151.945562:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085752448 00000100:00100000:2.0:1788684151.945592:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788684151.945598:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085752448:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788684151.945850:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684151.945857:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684151.945860:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684151.945891:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085752064:0@lo:400:kworker.0 00000100:00100000:0.0:1788684151.945903:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085752576:0@lo:400:kworker.0 00010000:00080000:0.0:1788684151.945915:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa80a80 x1875571085753088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684151.945925:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085753088:0@lo:400:kworker.0 00000100:00100000:0.0:1788684151.945976:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085751936 00000100:00100000:0.0:1788684151.945980:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085751936 00000100:00100000:0.0:1788684151.946011:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788684151.946018:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085751936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.946149:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085752960:12345-0@lo:400:kworker.0 Request processed in 857us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684151.946157:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788684151.946199:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085751936:12345-0@lo:400:kworker.0 Request processed in 181us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684151.946206:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788684151.946304:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085752448:12345-0@lo:400:kworker.0 Request processed in 705us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684151.946330:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788684151.950584:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085751936:0@lo:400:kworker.0 00000100:00100000:3.0:1788684151.950911:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085752448:0@lo:400:kworker.0 00010000:00080000:3.0:1788684151.950932:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa80000 x1875571085752960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684151.950943:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085752960:0@lo:400:kworker.0 00000100:00100000:3.0:1788684152.445643:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684152.445672:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085753472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684152.445761:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684152.445850:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085753472 00000100:00100000:3.0:1788684152.445869:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085753472 00000100:00100000:3.0:1788684152.445923:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788684152.445933:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085753472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684152.445978:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788684152.446032:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085753472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684152.446039:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788684152.446278:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085753344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684152.446314:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684152.446363:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085753344 00000100:00100000:2.0:1788684152.446391:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085753344 00000100:00100000:2.0:1788684152.446425:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788684152.446432:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085753344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684152.446456:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684152.446493:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085753344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684152.446500:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788684152.446534:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a7b80 x1875571085753344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684152.446557:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085753344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684152.446643:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684152.446657:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085753600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684152.446691:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684152.446826:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085753472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788684152.446892:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684152.446935:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085753600 00000100:00100000:2.0:1788684152.446940:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085753600 00000100:00100000:2.0:1788684152.446973:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788684152.446980:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085753600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684152.446991:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684152.449939:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085753600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2945us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684152.449958:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788684152.450320:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa6a680 x1875571085753600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684152.450349:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085753600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684152.957694:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085753728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684152.957797:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684152.957933:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085753728 00000100:00100000:3.0:1788684152.957943:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085753728 00000100:00100000:3.0:1788684152.958011:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788684152.958022:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085753728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684152.958067:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788684152.958144:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085753728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684152.958151:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788684152.958344:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085753728:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788684153.471508:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684154.498251:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684155.072903:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.072936:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073099904 00000100:00100000:3.0:1788684155.072945:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073099904 00000100:00100000:3.0:1788684155.072993:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 286 00000100:00100000:3.0:1788684155.073003:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2393:x1875571073099904:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684155.073064:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2393:x1875571073099904:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.073083:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 286 00000100:00100000:3.0:1788684155.077763:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.077818:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.077849:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073100032 00000100:00100000:3.0:1788684155.077857:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073100032 00000100:00100000:3.0:1788684155.077910:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073100160 00000100:00100000:3.0:1788684155.077913:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073100160 00000100:00100000:3.0:1788684155.077951:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 113 00000100:00100000:3.0:1788684155.077961:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073100032:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684155.078026:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073100032:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.078034:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 113 00000100:00100000:3.0:1788684155.078050:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00100000:3.0:1788684155.078056:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073100160:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684155.078092:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073100160:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.078098:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00080000:3.0:1788684155.078116:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684155.078119:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788684155.086319:0:11972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:42:33 (1788684153) === 00000100:00100000:3.0:1788684155.437873:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684155.438066:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073100288 00000100:00100000:0.0:1788684155.438105:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073100288 00000100:00100000:0.0:1788684155.438186:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 287 00000100:00100000:0.0:1788684155.438198:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:8718:x1875571073100288:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788684155.438222:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684155.438243:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d676d810e00/0x44bac02bd54ac402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3981 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684155.438281:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d676d810e00/0x44bac02bd54ac402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3981 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684155.439635:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d676d810e00/0x44bac02bd54ac402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3981 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684155.439649:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d676d810e00, rc 0) 00000100:00100000:0.0:1788684155.439760:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8718:x1875571073100288:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 1563us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684155.439769:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 287 00000100:00100000:0.0:1788684155.450120:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.453036:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073100416 00000100:00100000:3.0:1788684155.453058:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073100416 00000100:00100000:3.0:1788684155.453226:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 288 00000100:00100000:3.0:1788684155.453239:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8718:x1875571073100416:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788684155.454807:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8718:x1875571073100416:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 1557us (4686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.454832:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 288 00000100:00100000:1.0:1788684155.463360:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.463480:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073100544 00000100:00100000:3.0:1788684155.463568:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073100544 00000100:00100000:3.0:1788684155.463677:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 289 00000100:00100000:3.0:1788684155.463690:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8718:x1875571073100544:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788684155.463873:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8718:x1875571073100544:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 185us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.463882:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 289 00000100:00100000:3.0:1788684155.472955:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684155.473486:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073100672 00000100:00100000:0.0:1788684155.473559:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073100672 00000100:00100000:0.0:1788684155.473722:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 290 00000100:00100000:0.0:1788684155.473734:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8722:x1875571073100672:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788684155.473949:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8722:x1875571073100672:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 217us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684155.473958:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 290 00000100:00100000:1.0:1788684155.506487:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.506587:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073100800 00000100:00100000:3.0:1788684155.506599:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073100800 00000100:00100000:3.0:1788684155.506666:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 291 00000100:00100000:3.0:1788684155.506678:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8722:x1875571073100800:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684155.506859:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8722:x1875571073100800:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 182us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.506869:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 291 00000100:00100000:1.0:1788684155.512662:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684155.512863:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073100928 00000100:00100000:0.0:1788684155.512875:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073100928 00000100:00100000:0.0:1788684155.512957:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 292 00000100:00100000:0.0:1788684155.512969:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8722:x1875571073100928:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788684155.513916:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8722:x1875571073100928:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 943us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684155.513927:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 292 00010000:00010000:3.0:1788684155.517527:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684155.521975:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684155.522185:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073101056 00000100:00100000:2.0:1788684155.522198:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073101056 00000100:00100000:2.0:1788684155.522266:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 293 00000100:00100000:2.0:1788684155.522277:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+11:8718:x1875571073101056:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788684155.522299:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684155.522323:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477fe600/0x44bac02bd54ac409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed39b2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684155.522359:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477fe600/0x44bac02bd54ac409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b2 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684155.522406:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477fe600/0x44bac02bd54ac409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b2 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684155.522417:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477fe600, rc 0) 00000100:00100000:2.0:1788684155.522493:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+12:8718:x1875571073101056:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 217us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684155.522501:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 293 00000100:00100000:0.0:1788684155.529021:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684155.529127:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073101184 00000100:00100000:1.0:1788684155.529606:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073101184 00000100:00100000:1.0:1788684155.529674:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 294 00000100:00100000:1.0:1788684155.529685:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+12:8718:x1875571073101184:12345-192.168.206.44@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788684155.529716:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788684155.529743:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788684155.529978:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788684155.529982:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788684155.529986:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788684155.529989:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788684155.544050:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+12:8718:x1875571073101184:12345-192.168.206.44@tcp:256:mount.lustre.0 Request processed in 14330us (15006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684155.544086:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 294 00000100:00100000:0.0:1788684155.548118:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.548238:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073101312 00000100:00100000:3.0:1788684155.548250:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073101312 00000100:00100000:3.0:1788684155.548325:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 295 00000100:00100000:3.0:1788684155.548336:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+12:8718:x1875571073101312:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788684155.548561:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684155.548586:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed39b9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684155.548702:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b9 expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684155.548717:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b9 expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684155.548818:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711de00, rc 0) 00000100:00100000:3.0:1788684155.548964:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:8718:x1875571073101312:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 629us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.548973:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 295 00000100:00100000:1.0:1788684155.554849:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684155.555168:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073101440 00000100:00100000:2.0:1788684155.555181:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073101440 00000100:00100000:2.0:1788684155.555248:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 296 00000100:00100000:2.0:1788684155.555259:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:8718:x1875571073101440:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788684155.555823:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:8718:x1875571073101440:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 563us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684155.555854:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 296 00000100:00100000:1.0:1788684155.560528:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.560910:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073101568 00000100:00100000:3.0:1788684155.560923:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073101568 00000100:00100000:3.0:1788684155.561077:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 297 00000100:00100000:3.0:1788684155.561091:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:8718:x1875571073101568:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788684155.561628:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:8718:x1875571073101568:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 538us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.561637:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 297 00000100:00100000:0.0:1788684155.567081:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684155.567348:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073101696 00000100:00100000:2.0:1788684155.567362:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073101696 00000100:00100000:2.0:1788684155.567454:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 298 00000100:00100000:2.0:1788684155.567466:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:8728:x1875571073101696:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684155.567678:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:8728:x1875571073101696:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 212us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684155.567687:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 298 00000100:00100000:1.0:1788684155.571337:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.571767:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073101824 00000100:00100000:3.0:1788684155.571780:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073101824 00000100:00100000:3.0:1788684155.571897:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 299 00000100:00100000:3.0:1788684155.571910:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:8728:x1875571073101824:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684155.572114:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:8728:x1875571073101824:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 206us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.572123:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 299 00000100:00100000:1.0:1788684155.578444:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684155.578628:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.582256:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073101952 00000100:00100000:3.0:1788684155.582279:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073101952 00000100:00100000:2.0:1788684155.582455:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073102208 00000100:00100000:2.0:1788684155.582461:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073102208 00000100:00100000:2.0:1788684155.582489:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:2.0:1788684155.582498:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1875571073101952:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788684155.582537:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from be304e4e-7c60-433e-98d3-9fc97bdb0b28@192.168.206.44@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:2.0:1788684155.582581:0:6499:0:(genops.c:1385:class_connect()) connect: client be304e4e-7c60-433e-98d3-9fc97bdb0b28, cookie 0x44bac02bd54ac417 00000004:00100000:2.0:1788684155.582625:0:6499:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788684155.582769:0:6499:0:(import.c:65:import_set_state_nolock()) ffff8d664798e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684155.582854:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2389:x1875571073101952:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 356us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684155.582863:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:2.0:1788684155.582885:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:2.0:1788684155.582889:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1875571073102208:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788684155.582906:0:6499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from be304e4e-7c60-433e-98d3-9fc97bdb0b28@192.168.206.44@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:2.0:1788684155.582931:0:6499:0:(genops.c:1385:class_connect()) connect: client be304e4e-7c60-433e-98d3-9fc97bdb0b28, cookie 0x44bac02bd54ac41e 00000004:00100000:2.0:1788684155.582956:0:6499:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788684155.583045:0:6499:0:(import.c:65:import_set_state_nolock()) ffff8d664798d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684155.583085:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2389:x1875571073102208:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 193us (4456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684155.583093:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684155.588653:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684155.588703:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.588845:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073102336 00000100:00100000:3.0:1788684155.588858:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073102336 00000100:00100000:3.0:1788684155.588955:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073102080 00000100:00100000:3.0:1788684155.588959:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073102080 00000100:00100000:3.0:1788684155.588987:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1788684155.589013:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:0:x1875571073102336:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788684155.589062:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788684155.589177:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:0:x1875571073102336:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 166us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.589186:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1788684155.589205:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1788684155.589211:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:0:x1875571073102080:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788684155.589229:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788684155.589269:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:0:x1875571073102080:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 58us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.589275:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00080000:0.0:1788684155.589737:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684155.589743:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684155.599383:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684155.599535:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073102464 00000100:00100000:3.0:1788684155.599548:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073102464 00000100:00100000:3.0:1788684155.599713:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:3.0:1788684155.599726:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:8718:x1875571073102464:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788684155.599767:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788684155.599856:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:8718:x1875571073102464:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 133us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684155.599864:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1788684155.602873:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684155.603049:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073102592 00000100:00100000:0.0:1788684155.603062:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073102592 00000100:00100000:0.0:1788684155.603644:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:0.0:1788684155.603659:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:8718:x1875571073102592:12345-192.168.206.44@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788684155.603780:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:8718:x1875571073102592:12345-192.168.206.44@tcp:40:mount.lustre.0 Request processed in 125us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684155.603788:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:3.0:1788684155.605884:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684155.606126:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073102720 00000100:00100000:0.0:1788684155.606137:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073102720 00000100:00100000:0.0:1788684155.606193:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:0.0:1788684155.606202:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875571073102720:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788684155.606244:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from be304e4e-7c60-433e-98d3-9fc97bdb0b28@192.168.206.44@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:0.0:1788684155.606280:0:8411:0:(genops.c:1385:class_connect()) connect: client be304e4e-7c60-433e-98d3-9fc97bdb0b28, cookie 0x44bac02bd54ac425 00002000:00100000:0.0:1788684155.606295:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli be304e4e-7c60-433e-98d3-9fc97bdb0b28/ffff8d664789a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788684155.606319:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788684155.606467:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788684155.606507:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8d664789f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684155.607133:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2389:x1875571073102720:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 408us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684155.607146:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:2.0:1788684155.607982:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684155.608089:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073102976 00000100:00100000:0.0:1788684155.608099:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073102976 00000100:00100000:0.0:1788684155.608164:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:0.0:1788684155.608175:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:8718:x1875571073102976:12345-192.168.206.44@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788684155.608521:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:8718:x1875571073102976:12345-192.168.206.44@tcp:900:mount.lustre.0 Request processed in 346us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684155.608528:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:1.0:1788684155.611896:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684155.612080:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073102848 00000100:00100000:0.0:1788684155.612093:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073102848 00000100:00100000:0.0:1788684155.612157:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:0.0:1788684155.612168:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875571073102848:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788684155.612222:0:8413:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from be304e4e-7c60-433e-98d3-9fc97bdb0b28@192.168.206.44@tcp t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:0.0:1788684155.612263:0:8413:0:(genops.c:1385:class_connect()) connect: client be304e4e-7c60-433e-98d3-9fc97bdb0b28, cookie 0x44bac02bd54ac42c 00002000:00100000:0.0:1788684155.612279:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli be304e4e-7c60-433e-98d3-9fc97bdb0b28/ffff8d664789e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788684155.612509:0:8413:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788684155.612742:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788684155.612785:0:8413:0:(import.c:65:import_set_state_nolock()) ffff8d664789b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684155.612947:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2389:x1875571073102848:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 768us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684155.612958:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:3.0:1788684155.614472:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684155.614592:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073103104 00000100:00100000:2.0:1788684155.614621:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073103104 00000100:00100000:2.0:1788684155.614688:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:2.0:1788684155.614701:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:8718:x1875571073103104:12345-192.168.206.44@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788684155.614813:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788684155.614904:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:8718:x1875571073103104:12345-192.168.206.44@tcp:33:mount.lustre.0 Request processed in 205us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684155.614912:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00010000:00010000:2.0:1788684156.544358:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684157.054573:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684157.055616:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085753856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684157.055682:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684157.055827:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085753984:0@lo:400:kworker.0 00000100:00100000:0.0:1788684157.055864:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684157.055886:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085753856 00000100:00100000:2.0:1788684157.055895:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085753856 00000100:00100000:2.0:1788684157.055964:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788684157.055974:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085753856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684157.056001:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684157.056050:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085753856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684157.056057:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788684157.056087:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684157.056416:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085754112:0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.056450:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684157.056484:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085754112 00000100:00100000:2.0:1788684157.056494:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085754112 00000100:00100000:2.0:1788684157.056525:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788684157.056532:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085754112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.056573:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085754112:12345-0@lo:400:kworker.0 Request processed in 41us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684157.056581:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788684157.056602:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085753984 00000100:00100000:0.0:1788684157.056608:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085753984 00000100:00100000:2.0:1788684157.056624:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085754112:0@lo:400:kworker.0 00000100:00100000:0.0:1788684157.056645:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788684157.056654:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085753984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684157.056700:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085753984:12345-0@lo:400:kworker.0 Request processed in 48us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684157.056706:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788684157.056731:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085753984:0@lo:400:kworker.0 00000100:00100000:1.0:1788684157.057316:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085754368:0@lo:400:kworker.0 00000100:00100000:1.0:1788684157.057350:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684157.057406:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085754368 00000100:00100000:2.0:1788684157.057411:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085754368 00000100:00100000:1.0:1788684157.057424:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085754880:0@lo:400:kworker.0 00000100:00100000:1.0:1788684157.057450:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684157.057468:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085755392:0@lo:400:kworker.0 00000100:00100000:1.0:1788684157.057486:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684157.057507:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788684157.057513:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085754240:0@lo:400:kworker.0 00000100:00100000:1.0:1788684157.057536:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684157.057555:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085754752:0@lo:400:kworker.0 00000100:00100000:1.0:1788684157.057575:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684157.057605:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085755264:0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.057620:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085754752 00000100:00100000:2.0:1788684157.057625:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085754752 00000100:00100000:1.0:1788684157.057632:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684157.057657:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788684157.057665:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085754368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684157.057671:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788684157.057683:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085754752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.057730:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085754368:12345-0@lo:400:kworker.0 Request processed in 64us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684157.057733:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085754752:12345-0@lo:400:kworker.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684157.057741:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788684157.057762:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085754880 00000100:00100000:2.0:1788684157.057764:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085754880 00000100:00100000:2.0:1788684157.057785:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085755392 00000100:00100000:2.0:1788684157.057788:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085755392 00000100:00100000:2.0:1788684157.057800:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085755264 00000100:00100000:2.0:1788684157.057802:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085755264 00000100:00100000:2.0:1788684157.057815:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684157.057820:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085754880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.057852:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085754880:12345-0@lo:400:kworker.0 Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684157.057866:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684157.057878:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788684157.057885:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085755392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684157.057907:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788684157.057919:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085755264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684157.057958:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085755264:12345-0@lo:400:kworker.0 Request processed in 44us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684157.057965:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788684157.057984:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085754496:0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.058035:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085755392:12345-0@lo:400:kworker.0 Request processed in 40us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684157.058043:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788684157.058077:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1788684157.058078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684157.058082:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684157.058085:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788684157.058108:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085754624:0@lo:400:kworker.0 00010000:00080000:2.0:1788684157.058115:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f8700 x1875571085754752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684157.058127:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085754752:0@lo:400:kworker.0 00010000:00080000:2.0:1788684157.058140:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772fa680 x1875571085755264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684157.058144:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684157.058154:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085755264:0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.058168:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085754368:0@lo:400:kworker.0 00000100:00100000:1.0:1788684157.058172:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085755136:0@lo:400:kworker.0 00010000:00080000:2.0:1788684157.058181:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f9c00 x1875571085754880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684157.058188:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085754880:0@lo:400:kworker.0 00010000:00080000:2.0:1788684157.058196:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f8e00 x1875571085755392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684157.058202:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085755392:0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.058229:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085754624 00000100:00100000:2.0:1788684157.058237:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085754624 00000100:00100000:2.0:1788684157.058264:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788684157.058272:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085754624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684157.058277:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788684157.058322:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647744380 x1875571085753856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684157.058339:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085753856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684157.058813:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085754624:12345-0@lo:400:kworker.0 Request processed in 542us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684157.058820:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788684157.058831:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085755136 00000100:00100000:2.0:1788684157.058834:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085755136 00000100:00100000:2.0:1788684157.058856:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788684157.058863:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085755136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.058892:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085755136:12345-0@lo:400:kworker.0 Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684157.058898:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788684157.058902:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085754240 00000100:00100000:3.0:1788684157.058906:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085754240 00000100:00100000:2.0:1788684157.058923:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085754624:0@lo:400:kworker.0 00000100:00100000:3.0:1788684157.058934:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788684157.058940:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085754240:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788684157.058947:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f9880 x1875571085755136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684157.058956:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085755136:0@lo:400:kworker.0 00000100:00080000:2.0:1788684157.058989:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684157.058992:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684157.059097:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085754240:12345-0@lo:400:kworker.0 Request processed in 156us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684157.059105:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788684157.059127:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684157.059151:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085754496 00000100:00100000:3.0:1788684157.059156:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085754496 00000100:00100000:0.0:1788684157.059159:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085755008:0@lo:400:kworker.0 00000100:00100000:3.0:1788684157.059182:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788684157.059189:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085754496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684157.059221:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085754496:12345-0@lo:400:kworker.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684157.059227:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788684157.059263:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684157.059277:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085754240:0@lo:400:kworker.0 00000100:00100000:0.0:1788684157.059299:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085755520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684157.059323:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684157.059329:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085755008 00000100:00100000:3.0:1788684157.059335:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085755008 00000100:00100000:0.0:1788684157.059362:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085754496:0@lo:400:kworker.0 00000100:00100000:3.0:1788684157.059394:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788684157.059404:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085755008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684157.059441:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085755008:12345-0@lo:400:kworker.0 Request processed in 41us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684157.059447:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1788684157.059462:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684157.059480:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085755008:0@lo:400:kworker.0 00000100:00100000:2.0:1788684157.059551:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085755520 00000100:00100000:2.0:1788684157.059555:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085755520 00000100:00100000:2.0:1788684157.059619:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788684157.059626:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085755520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684157.059641:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684157.059683:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085755520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684157.059706:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788684157.059880:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772fb100 x1875571085755520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684157.059893:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085755520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684157.565636:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684157.565656:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085755648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684157.565721:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684157.565795:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085755648 00000100:00100000:1.0:1788684157.565803:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085755648 00000100:00100000:1.0:1788684157.565848:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788684157.565856:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085755648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684157.565884:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684157.565927:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085755648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684157.565935:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788684157.565980:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f8000 x1875571085755648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684157.565999:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085755648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684157.566228:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684157.566240:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085755776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684157.566296:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684157.566430:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085755776 00000100:00100000:2.0:1788684157.566435:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085755776 00000100:00100000:2.0:1788684157.566464:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788684157.566471:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085755776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684157.566482:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684157.566517:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085755776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684157.566524:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788684157.566550:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa81500 x1875571085755776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684157.566563:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085755776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684157.568517:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684157.568532:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085755904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684157.568584:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684157.568624:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085755904 00000100:00100000:1.0:1788684157.568630:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085755904 00000100:00100000:1.0:1788684157.568668:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788684157.568676:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085755904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684157.568702:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684157.568878:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085755904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684157.568886:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788684157.568960:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085755904:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788684157.569145:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684158.077753:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085756032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684158.077826:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684158.077936:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085756032 00000100:00100000:2.0:1788684158.077944:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085756032 00000100:00100000:2.0:1788684158.077993:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788684158.078000:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085756032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684158.078030:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788684158.080866:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085756032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2856us (3030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684158.080880:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788684158.080937:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085756032:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684158.589517:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684159.615698:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788684160.159309:0:12165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788684160.637563:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684160.697320:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684160.697395:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684160.697421:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684160.697442:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684160.697462:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684160.697481:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684160.697502:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684160.697532:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073103488 00000100:00100000:0.0:1788684160.697544:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073103488 00000100:00100000:0.0:1788684160.697604:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073103744 00000100:00100000:0.0:1788684160.697607:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073103744 00000100:00100000:0.0:1788684160.697621:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073103360 00000100:00100000:0.0:1788684160.697624:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073103360 00000100:00100000:0.0:1788684160.697639:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073103616 00000100:00100000:0.0:1788684160.697641:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073103616 00000100:00100000:0.0:1788684160.697660:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:0.0:1788684160.697671:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073103488:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684160.697766:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073103488:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 96us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684160.697775:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:0.0:1788684160.697796:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:0.0:1788684160.697803:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073103744:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684160.697828:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073103744:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684160.697845:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:0.0:1788684160.697857:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:0.0:1788684160.697863:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2391:x1875571073103360:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684160.697885:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2391:x1875571073103360:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684160.697891:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:0.0:1788684160.697900:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:0.0:1788684160.697906:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073103616:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684160.697926:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073103616:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 20us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684160.697932:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:0.0:1788684160.697955:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073104000 00000100:00100000:0.0:1788684160.697958:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073104000 00000100:00100000:0.0:1788684160.697984:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073103872 00000100:00100000:0.0:1788684160.697987:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073103872 00000100:00100000:0.0:1788684160.698007:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:0.0:1788684160.698013:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073104000:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684160.698232:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073103232 00000100:00100000:1.0:1788684160.698238:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073103232 00000100:00100000:1.0:1788684160.698275:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 301 00000100:00100000:1.0:1788684160.698282:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073103232:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684160.698313:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073103232:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 32us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684160.698320:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 301 00000100:00100000:1.0:1788684160.698534:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:1.0:1788684160.698542:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073103872:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684160.698574:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073103872:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 33us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684160.698589:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:0.0:1788684160.698862:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073104000:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 846us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684160.698870:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00080000:3.0:1788684160.700049:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684160.700057:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684160.700061:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684160.700071:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1788684161.155750:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000001:00100000:3.0:1788684161.156932:0:6476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000001:00100000:3.0:1788684161.159950:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000001:00100000:3.0:1788684161.160147:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of be304e4e-7c60-433e-98d3-9fc97bdb0b28 00010000:00010000:3.0:1788684161.661582:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684162.176134:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085756160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684162.176205:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684162.178939:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085756288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684162.179003:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684162.179161:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085756160 00000100:00100000:1.0:1788684162.179170:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085756160 00000100:00100000:1.0:1788684162.179247:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085756288 00000100:00100000:1.0:1788684162.179251:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085756288 00000100:00100000:2.0:1788684162.179540:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788684162.179551:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085756160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684162.179577:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684162.179629:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085756160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684162.179637:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788684162.181409:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085756800:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.181464:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684162.181510:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085757312:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.181533:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684162.181561:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788684162.181568:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085756416:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.181597:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684162.181617:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085756928:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.181640:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684162.181658:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085757440:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.181676:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684162.181701:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085756416 00000100:00100000:2.0:1788684162.181706:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085756416 00000100:00100000:2.0:1788684162.181742:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788684162.181749:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085756416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.181790:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085756416:12345-0@lo:400:kworker.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684162.181797:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788684162.181828:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085756928 00000100:00100000:2.0:1788684162.181832:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085756928 00000100:00100000:2.0:1788684162.181856:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788684162.181861:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085756928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.181894:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085756928:12345-0@lo:400:kworker.0 Request processed in 33us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684162.181908:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788684162.181946:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085756416:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.181958:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085756928:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.181990:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085756672:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.182016:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684162.182044:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085757184:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.182069:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684162.182085:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085757696:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.182104:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684162.182188:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085756800 00000100:00100000:0.0:1788684162.182193:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085756800 00000100:00100000:0.0:1788684162.182216:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085757312 00000100:00100000:0.0:1788684162.182218:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085757312 00000100:00080000:3.0:1788684162.182275:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684162.182279:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684162.182288:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085757440 00000100:00100000:3.0:1788684162.182291:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085757440 00000100:00100000:3.0:1788684162.182311:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085757184 00000100:00100000:3.0:1788684162.182313:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085757184 00000100:00100000:3.0:1788684162.182325:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788684162.182331:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085756800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684162.182443:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788684162.182449:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085756288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684162.182463:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684162.182532:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085756800:12345-0@lo:400:kworker.0 Request processed in 201us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684162.182537:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788684162.182549:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788684162.182554:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085757440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684162.182574:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085757440:12345-0@lo:400:kworker.0 Request processed in 21us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684162.182579:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788684162.182587:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788684162.182591:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085757184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684162.182623:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085757184:12345-0@lo:400:kworker.0 Request processed in 31us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684162.182628:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:3.0:1788684162.182656:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777099180 x1875571085757440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684162.182665:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085757440:0@lo:400:kworker.0 00000100:00100000:3.0:1788684162.182673:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085756800:0@lo:400:kworker.0 00000100:00080000:3.0:1788684162.182690:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684162.182788:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788684162.182801:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085757312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684162.182840:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085757312:12345-0@lo:400:kworker.0 Request processed in 40us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684162.182847:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788684162.182870:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085756544:0@lo:400:kworker.0 00000100:00100000:0.0:1788684162.182898:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684162.182915:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085757056:0@lo:400:kworker.0 00000100:00100000:0.0:1788684162.182936:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684162.182951:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085757568:0@lo:400:kworker.0 00000100:00100000:0.0:1788684162.182971:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684162.182997:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085756544 00000100:00100000:0.0:1788684162.183002:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085756544 00000100:00100000:0.0:1788684162.183016:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085757056 00000100:00100000:0.0:1788684162.183018:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085757056 00000100:00100000:0.0:1788684162.183031:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788684162.183049:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085756544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684162.183082:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085756544:12345-0@lo:400:kworker.0 Request processed in 34us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684162.183088:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788684162.183099:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788684162.183104:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085757056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684162.183128:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085757056:12345-0@lo:400:kworker.0 Request processed in 25us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684162.183133:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788684162.183149:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085757696 00000100:00100000:0.0:1788684162.183153:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085757696 00000100:00100000:0.0:1788684162.183182:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085757568 00000100:00100000:0.0:1788684162.183185:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085757568 00000100:00100000:0.0:1788684162.183210:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684162.183216:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085757696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684162.183248:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085757696:12345-0@lo:400:kworker.0 Request processed in 33us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684162.183253:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684162.183262:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788684162.183268:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085757568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684162.183293:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085757568:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684162.183298:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788684162.183321:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085756544:0@lo:400:kworker.0 00000100:00100000:0.0:1788684162.183330:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085757056:0@lo:400:kworker.0 00010000:00080000:0.0:1788684162.183339:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677709b480 x1875571085757568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684162.183348:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085757568:0@lo:400:kworker.0 00000100:00100000:3.0:1788684162.185708:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085757312:0@lo:400:kworker.0 00000100:00080000:3.0:1788684162.185739:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684162.185745:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788684162.187061:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6775ef5f80 x1875571085757696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684162.187077:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085757696:0@lo:400:kworker.0 00010000:00080000:2.0:1788684162.187094:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e0000 x1875571085756160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684162.187113:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085756160:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788684162.187149:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677709aa00 x1875571085757184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684162.187158:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085757184:0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.187182:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085756672 00000100:00100000:2.0:1788684162.187188:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085756672 00000100:00100000:2.0:1788684162.187234:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788684162.187243:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085756672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684162.187316:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085756672:12345-0@lo:400:kworker.0 Request processed in 74us (5298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684162.187323:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788684162.187358:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085756672:0@lo:400:kworker.0 00000100:00100000:1.0:1788684162.189568:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085756288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7111us (10557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684162.189579:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788684162.193862:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66477eea00 x1875571085756288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684162.193887:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085756288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684162.685499:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684162.685520:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085757824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684162.685584:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684162.685629:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085757824 00000100:00100000:2.0:1788684162.685637:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085757824 00000100:00100000:2.0:1788684162.685689:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788684162.685698:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085757824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684162.685724:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00010000:0.0:1788684162.685758:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684162.685766:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085757824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684162.685774:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788684162.685854:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67770e0000 x1875571085757824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684162.685871:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085757824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684162.685956:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684162.685966:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085757952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684162.685994:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684162.686101:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085758080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684162.686102:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085757952 00000100:00100000:1.0:1788684162.686106:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085757952 00000100:00100000:2.0:1788684162.686127:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684162.686151:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788684162.686159:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085757952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684162.686180:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788684162.686243:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085758080 00000100:00100000:0.0:1788684162.686256:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085758080 00000100:00100000:0.0:1788684162.686280:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788684162.686286:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085758080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684162.686296:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684162.686326:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085758080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684162.686350:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788684162.686389:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66477eca80 x1875571085758080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684162.686402:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085758080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684162.686493:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085757952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 334us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684162.686500:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788684162.687053:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085757952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684163.198707:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684163.198728:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085758208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684163.198798:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684163.198988:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085758208 00000100:00100000:0.0:1788684163.198996:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085758208 00000100:00100000:0.0:1788684163.199054:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788684163.199064:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085758208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684163.199095:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788684163.199152:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085758208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684163.199159:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684163.199235:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085758208:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788684163.709746:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684164.734112:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684165.760145:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684165.818302:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684165.818354:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684165.818428:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073104128 00000100:00100000:1.0:1788684165.818442:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684165.818445:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073104128 00000100:00100000:1.0:1788684165.818494:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684165.818518:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684165.818529:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 303 00000100:00100000:1.0:1788684165.818549:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684165.818561:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073104128:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684165.818655:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073104128:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 101us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684165.818663:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 303 00000100:00100000:2.0:1788684165.819232:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073104896 00000100:00100000:2.0:1788684165.819239:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073104896 00000100:00100000:0.0:1788684165.819319:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073104256 00000100:00100000:2.0:1788684165.819328:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:0.0:1788684165.819332:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073104256 00000100:00100000:2.0:1788684165.819342:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073104896:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684165.819423:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073104384 00000100:00100000:0.0:1788684165.819428:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073104384 00000100:00100000:2.0:1788684165.819448:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073104896:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 107us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684165.819450:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073104512 00000100:00100000:0.0:1788684165.819456:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073104512 00000100:00100000:2.0:1788684165.819465:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:0.0:1788684165.819478:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073104640 00000100:00100000:0.0:1788684165.819483:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073104640 00000100:00100000:0.0:1788684165.819508:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:0.0:1788684165.819518:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073104256:12345-192.168.206.44@tcp:400:kworker.0 00000100:00080000:1.0:1788684165.819740:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684165.819747:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684165.819750:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684165.819846:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:3.0:1788684165.819858:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073104384:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684165.822045:0:7963:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788684165.822063:0:7963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788684165.822340:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788684165.822358:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:1.0:1788684165.822560:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073104512:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684165.823482:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073104512:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 1108us (4983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684165.823495:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:1.0:1788684165.823529:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788684165.823539:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:1.0:1788684165.823549:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073104640:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684165.823584:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073104640:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 38us (5065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684165.823591:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:3.0:1788684165.831037:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073104384:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 11150us (12565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684165.831060:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:0.0:1788684165.835596:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073104256:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 16052us (17214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684165.835618:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:1.0:1788684165.835714:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684165.835940:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073104768 00000100:00100000:2.0:1788684165.835953:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073104768 00000100:00080000:0.0:1788684165.836702:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684165.836776:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:2.0:1788684165.836789:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073104768:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684165.836951:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073104768:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 164us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684165.836960:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000020:00000004:0.0:1788684166.591851:0:12481:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684166.592171:0:12481:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788684166.781715:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684167.293717:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684167.293739:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085758336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684167.293816:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.293889:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085758336 00000100:00100000:3.0:1788684167.293897:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085758336 00000100:00100000:3.0:1788684167.293948:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788684167.293957:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085758336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684167.293983:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684167.294038:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085758336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684167.294045:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788684167.294066:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788684167.294095:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677709a680 x1875571085758336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684167.294113:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085758336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684167.294659:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684167.294670:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085758464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684167.294714:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684167.294749:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085758464 00000100:00100000:0.0:1788684167.294754:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085758464 00000100:00100000:0.0:1788684167.294800:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684167.294807:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085758464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684167.294819:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684167.294854:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085758464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684167.294860:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788684167.294889:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788684167.294911:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66477edc00 x1875571085758464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684167.294923:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085758464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684167.295336:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085758592:0@lo:400:kworker.0 00000100:00100000:2.0:1788684167.295438:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.295502:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085758592 00000100:00100000:3.0:1788684167.295507:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085758592 00000100:00100000:3.0:1788684167.295538:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788684167.295556:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085758592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684167.295832:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085758720:0@lo:400:kworker.0 00000100:00100000:0.0:1788684167.295864:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.296097:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085758592:12345-0@lo:400:kworker.0 Request processed in 550us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684167.296104:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788684167.296178:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085758592:0@lo:400:kworker.0 00000100:00100000:2.0:1788684167.296212:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085758720 00000100:00100000:2.0:1788684167.296217:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085758720 00000100:00100000:2.0:1788684167.296253:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788684167.296259:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085758720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684167.296313:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085758720:12345-0@lo:400:kworker.0 Request processed in 53us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684167.296320:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788684167.296401:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085758720:0@lo:400:kworker.0 00000100:00100000:0.0:1788684167.296686:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085758848:0@lo:400:kworker.0 00000100:00100000:0.0:1788684167.296717:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.296842:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085758976:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.296882:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684167.297060:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085758848 00000100:00100000:2.0:1788684167.297065:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085758848 00000100:00100000:2.0:1788684167.297103:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788684167.297111:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085758848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.297327:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085759104:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.297355:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.297403:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085759616:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.297440:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.297461:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788684167.297467:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085759232:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.297489:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.297507:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085759744:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.297528:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.297567:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085758976 00000100:00100000:3.0:1788684167.297571:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085758976 00000100:00100000:3.0:1788684167.297597:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085759616 00000100:00100000:3.0:1788684167.297600:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085759616 00000100:00100000:3.0:1788684167.297622:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085759232 00000100:00100000:3.0:1788684167.297625:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085759232 00000100:00100000:3.0:1788684167.297638:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788684167.297644:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085758976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.297675:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085758976:12345-0@lo:400:kworker.0 Request processed in 31us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684167.297682:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788684167.297695:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788684167.297700:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085759616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.297731:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085759616:12345-0@lo:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684167.297743:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788684167.297755:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788684167.297761:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085759232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.297801:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085759232:12345-0@lo:400:kworker.0 Request processed in 40us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684167.297807:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788684167.297828:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684167.297832:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684167.297859:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085759232:0@lo:400:kworker.0 00010000:00080000:3.0:1788684167.298044:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664795a680 x1875571085759616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684167.298056:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085759616:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298081:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085759488:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298105:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.298130:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085758976:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298141:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788684167.298145:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085759360:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298165:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.298180:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085759872:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298196:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684167.298220:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085759744 00000100:00100000:3.0:1788684167.298224:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085759744 00000100:00100000:3.0:1788684167.298251:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085759872 00000100:00100000:3.0:1788684167.298255:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085759872 00000100:00100000:3.0:1788684167.298284:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788684167.298291:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085759744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298326:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085759744:12345-0@lo:400:kworker.0 Request processed in 36us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684167.298332:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788684167.298343:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788684167.298349:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085759872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298398:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085759872:12345-0@lo:400:kworker.0 Request processed in 49us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684167.298404:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788684167.298425:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085759488 00000100:00100000:3.0:1788684167.298429:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085759488 00000100:00100000:3.0:1788684167.298448:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085759360 00000100:00100000:3.0:1788684167.298451:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085759360 00000100:00100000:3.0:1788684167.298464:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788684167.298470:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085759488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298498:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085759488:12345-0@lo:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684167.298509:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788684167.298520:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788684167.298527:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085759360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684167.298546:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085758848:12345-0@lo:400:kworker.0 Request processed in 1435us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684167.298555:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788684167.298569:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085759104 00000100:00100000:2.0:1788684167.298572:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085759104 00000100:00100000:2.0:1788684167.298595:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788684167.298601:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085759104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298626:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085759360:12345-0@lo:400:kworker.0 Request processed in 99us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684167.298629:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085759104:12345-0@lo:400:kworker.0 Request processed in 29us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684167.298633:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788684167.298635:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788684167.298651:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684167.298654:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684167.298656:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788684167.298680:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647958e00 x1875571085759744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684167.298692:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085759744:0@lo:400:kworker.0 00010000:00080000:3.0:1788684167.298856:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664795bb80 x1875571085759360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684167.298866:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085759360:0@lo:400:kworker.0 00010000:00080000:3.0:1788684167.298947:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664795b100 x1875571085759872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684167.298956:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085759872:0@lo:400:kworker.0 00000100:00100000:3.0:1788684167.298967:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085759488:0@lo:400:kworker.0 00000100:00100000:0.0:1788684167.299073:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085758848:0@lo:400:kworker.0 00000100:00100000:2.0:1788684167.299149:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085759104:0@lo:400:kworker.0 00000100:00100000:1.0:1788684167.806512:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684167.806535:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085760000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684167.806603:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684167.806664:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085760000 00000100:00100000:1.0:1788684167.806671:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085760000 00000100:00100000:1.0:1788684167.806710:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788684167.806717:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085760000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684167.806756:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684167.806801:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085760000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684167.806808:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788684167.806855:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085760000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684167.807321:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085760128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684167.807355:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684167.807556:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085760128 00000100:00100000:0.0:1788684167.807561:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085760128 00000100:00100000:0.0:1788684167.807596:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788684167.807604:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085760128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684167.807623:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684167.807664:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085760128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684167.807681:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788684167.807708:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66477ee680 x1875571085760128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684167.807721:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085760128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684167.808359:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085760256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684167.808416:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684167.808515:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085760256 00000100:00100000:2.0:1788684167.808519:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085760256 00000100:00100000:2.0:1788684167.808557:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788684167.808563:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085760256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684167.808575:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684167.808605:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085760256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684167.808611:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788684167.808667:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d33100 x1875571085760256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684167.808681:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085760256:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788684167.809328:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684168.317510:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684168.317531:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085760384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684168.317601:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684168.322221:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085760384 00000100:00100000:1.0:1788684168.322242:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085760384 00000100:00100000:1.0:1788684168.322302:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788684168.322312:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67489c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085760384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684168.322347:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788684168.322444:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67489c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085760384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684168.322452:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788684168.322767:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085760384:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1788684168.693173:0:12578:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788684168.693482:0:12578:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788684168.831859:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684169.854488:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788684170.814198:0:12676:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684170.815011:0:12676:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788684170.878564:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684170.942839:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684170.942924:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684170.942955:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684170.942978:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684170.943030:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684170.943048:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684170.943073:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684170.943104:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073105280 00000100:00100000:1.0:1788684170.943117:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073105280 00000100:00100000:1.0:1788684170.943204:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073105536 00000100:00100000:1.0:1788684170.943208:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073105536 00000100:00100000:1.0:1788684170.943226:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073105152 00000100:00100000:1.0:1788684170.943229:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073105152 00000100:00100000:1.0:1788684170.943242:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073105408 00000100:00100000:1.0:1788684170.943244:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073105408 00000100:00100000:1.0:1788684170.943261:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:1.0:1788684170.943271:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073105280:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684170.943402:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073105280:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 129us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684170.943410:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:1.0:1788684170.943431:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:1.0:1788684170.943437:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073105536:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684170.943464:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073105536:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684170.943471:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:1.0:1788684170.943481:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:1.0:1788684170.943487:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073105152:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684170.943510:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073105152:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684170.943516:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:1.0:1788684170.943537:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:1.0:1788684170.943543:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073105408:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684170.943567:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073105408:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684170.943573:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:1.0:1788684170.943594:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073105792 00000100:00100000:1.0:1788684170.943598:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073105792 00000100:00100000:1.0:1788684170.943630:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073105664 00000100:00100000:1.0:1788684170.943634:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073105664 00000100:00100000:1.0:1788684170.943663:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:1.0:1788684170.943670:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073105792:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684170.943693:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073105792:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684170.943700:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:1.0:1788684170.943709:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:1.0:1788684170.943714:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073105664:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684170.943732:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073105664:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 18us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684170.943738:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00080000:1.0:1788684170.943763:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788684170.943768:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788684170.943771:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684170.943773:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684170.951899:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073105024 00000100:00100000:3.0:1788684170.951922:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073105024 00000100:00100000:3.0:1788684170.952018:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 305 00000100:00100000:3.0:1788684170.952030:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073105024:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684170.952141:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073105024:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 114us (9316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684170.952149:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 305 00010000:00010000:1.0:1788684171.902500:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684172.413620:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085760640:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.413686:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.413754:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085761152:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.413777:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.413802:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085761664:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.413824:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.413852:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788684172.413865:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085760768:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.413941:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.413960:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085761280:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.413990:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.414006:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085761792:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414026:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.414056:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085760640 00000100:00100000:1.0:1788684172.414063:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085760640 00000100:00100000:1.0:1788684172.414099:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085761152 00000100:00100000:1.0:1788684172.414102:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085761152 00000100:00100000:1.0:1788684172.414123:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085761664 00000100:00100000:1.0:1788684172.414125:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085761664 00000100:00100000:1.0:1788684172.414135:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085761280 00000100:00100000:1.0:1788684172.414137:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085761280 00000100:00100000:1.0:1788684172.414147:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085761792 00000100:00100000:1.0:1788684172.414149:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085761792 00000100:00100000:1.0:1788684172.414163:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788684172.414170:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085760640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414217:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085760640:12345-0@lo:400:kworker.0 Request processed in 47us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.414224:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788684172.414240:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788684172.414246:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085761152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414282:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085761152:12345-0@lo:400:kworker.0 Request processed in 37us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.414288:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788684172.414300:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788684172.414306:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085761664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414331:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085761664:12345-0@lo:400:kworker.0 Request processed in 25us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.414336:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788684172.414346:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788684172.414352:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085761280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414400:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085761280:12345-0@lo:400:kworker.0 Request processed in 48us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.414405:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788684172.414415:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788684172.414420:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085761792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414445:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085761792:12345-0@lo:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.414450:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788684172.414473:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085760768 00000100:00100000:1.0:1788684172.414477:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085760768 00000100:00100000:1.0:1788684172.414500:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788684172.414506:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085760768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414542:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085760768:12345-0@lo:400:kworker.0 Request processed in 36us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.414548:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788684172.414574:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684172.414578:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684172.414606:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085760768:0@lo:400:kworker.0 00010000:00080000:1.0:1788684172.414620:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664795bb80 x1875571085761280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684172.414630:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085761280:0@lo:400:kworker.0 00010000:00080000:1.0:1788684172.414640:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647958000 x1875571085761792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684172.414649:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085761792:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414658:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085760640:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414666:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085761152:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.414673:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085761664:0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.414798:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085760896:0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.414828:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684172.414847:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085761408:0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.414866:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684172.414879:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085761920:0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.414895:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684172.414909:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788684172.414915:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085760512:0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.414937:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684172.414955:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085761024:0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.414973:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684172.415003:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085761536:0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.415023:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684172.415038:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085762048:0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.415055:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684172.415077:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085760896 00000100:00100000:0.0:1788684172.415081:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085760896 00000100:00100000:0.0:1788684172.415110:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788684172.415116:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085760896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.415149:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085760896:12345-0@lo:400:kworker.0 Request processed in 33us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684172.415155:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788684172.415171:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085761024 00000100:00100000:0.0:1788684172.415174:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085761024 00000100:00100000:0.0:1788684172.415192:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788684172.415198:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085761024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.415225:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085761024:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684172.415231:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788684172.415246:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085761408 00000100:00100000:0.0:1788684172.415249:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085761408 00000100:00100000:0.0:1788684172.415269:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085761920 00000100:00100000:0.0:1788684172.415272:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085761920 00000100:00100000:0.0:1788684172.415282:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085761536 00000100:00100000:0.0:1788684172.415284:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085761536 00000100:00100000:0.0:1788684172.415294:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085762048 00000100:00100000:0.0:1788684172.415296:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085762048 00000100:00100000:0.0:1788684172.415308:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788684172.415313:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085761408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.415340:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085761408:12345-0@lo:400:kworker.0 Request processed in 26us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684172.415346:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788684172.415355:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788684172.415360:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085761920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.415402:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085761920:12345-0@lo:400:kworker.0 Request processed in 42us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684172.415414:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788684172.415426:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684172.415431:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085761536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.415454:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085761536:12345-0@lo:400:kworker.0 Request processed in 23us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684172.415460:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684172.415470:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788684172.415475:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085762048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.415496:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085762048:12345-0@lo:400:kworker.0 Request processed in 22us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684172.415502:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788684172.415518:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684172.415521:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684172.415541:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085761024:0@lo:400:kworker.0 00010000:00080000:0.0:1788684172.415551:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664795a680 x1875571085761536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684172.415560:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085761536:0@lo:400:kworker.0 00010000:00080000:0.0:1788684172.415568:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646712300 x1875571085762048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684172.415576:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085762048:0@lo:400:kworker.0 00000100:00100000:0.0:1788684172.415586:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085760896:0@lo:400:kworker.0 00010000:00080000:0.0:1788684172.415595:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647958a80 x1875571085761408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684172.415615:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085761408:0@lo:400:kworker.0 00010000:00080000:0.0:1788684172.415626:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646712680 x1875571085761920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684172.415634:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085761920:0@lo:400:kworker.0 00000100:00100000:3.0:1788684172.415764:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085760512 00000100:00100000:3.0:1788684172.415769:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085760512 00000100:00100000:3.0:1788684172.415796:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788684172.415803:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085760512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684172.415841:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085760512:12345-0@lo:400:kworker.0 Request processed in 38us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684172.415847:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788684172.415892:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085760512:0@lo:400:kworker.0 00000100:00100000:1.0:1788684172.416030:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788684172.416040:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085762176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684172.416070:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.416099:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085762176 00000100:00100000:1.0:1788684172.416103:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085762176 00000100:00100000:1.0:1788684172.416127:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788684172.416132:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085762176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684172.416151:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684172.416182:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085762176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.416189:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788684172.416216:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6751b54e00 x1875571085762176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684172.416236:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085762176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684172.416347:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684172.416356:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085762304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684172.416405:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684172.423255:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085762304 00000100:00100000:0.0:1788684172.423271:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085762304 00000100:00100000:0.0:1788684172.423327:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788684172.423337:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085762304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788684172.423395:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684172.423473:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085762304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (7066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684172.423480:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788684172.423583:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646712680 x1875571085762304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684172.423603:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085762304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788684172.926353:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684172.929761:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085762432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684172.929837:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.929906:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684172.929914:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085762560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684172.929940:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.929988:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085762688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684172.930017:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684172.930053:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085762432 00000100:00100000:1.0:1788684172.930060:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085762432 00000100:00100000:1.0:1788684172.930095:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085762560 00000100:00100000:1.0:1788684172.930098:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085762560 00000100:00100000:1.0:1788684172.930114:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788684172.930122:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085762432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684172.930149:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684172.930193:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085762432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.930201:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788684172.930218:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788684172.930224:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085762560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684172.930234:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684172.930259:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085762560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.930266:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788684172.930287:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085762688 00000100:00100000:1.0:1788684172.930303:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085762688 00000100:00100000:1.0:1788684172.930332:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788684172.930338:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085762688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684172.930360:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684172.930416:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085762688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684172.930423:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788684172.930460:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085762688:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788684172.930489:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6751b54700 x1875571085762560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684172.930501:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085762560:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788684172.930510:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6751b54e00 x1875571085762432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684172.930520:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085762432:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1788684173.223363:0:12774:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684173.223777:0:12774:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788684173.437581:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684173.437613:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085762816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684173.437703:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684173.437905:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085762816 00000100:00100000:0.0:1788684173.437916:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085762816 00000100:00100000:0.0:1788684173.437990:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788684173.438002:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085762816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684173.438055:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788684173.438123:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085762816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684173.438131:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788684173.438185:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085762816:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788684173.952083:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684174.974563:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788684175.575543:0:12871:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684175.576532:0:12871:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788684176.001239:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684176.058472:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684176.058516:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684176.058563:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684176.058770:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073106560 00000100:00100000:2.0:1788684176.058783:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073106560 00000100:00100000:2.0:1788684176.058867:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1788684176.058879:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2389:x1875571073106560:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:2.0:1788684176.058917:0:9991:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac425 00000100:00080000:2.0:1788684176.058929:0:9991:0:(import.c:65:import_set_state_nolock()) ffff8d664789f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788684176.058995:0:9991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788684176.059195:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+2:2389:x1875571073106560:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 318us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684176.059203:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1788684176.059228:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073105920 00000100:00100000:2.0:1788684176.059231:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073105920 00000100:00100000:2.0:1788684176.059257:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 307 00000100:00100000:2.0:1788684176.059263:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073105920:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684176.059285:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073105920:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684176.059310:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 307 00010000:00010000:2.0:1788684176.059340:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788684176.060014:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684176.060083:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073106048 00000100:00100000:0.0:1788684176.060100:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073106048 00000100:00100000:0.0:1788684176.060170:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 151 00000100:00100000:0.0:1788684176.060187:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073106048:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684176.060251:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073106048:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 73us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684176.060257:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 151 00000100:00080000:3.0:1788684176.060735:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684176.062331:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684176.062717:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073106304 00000100:00100000:2.0:1788684176.062729:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073106304 00000100:00100000:2.0:1788684176.062806:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:2.0:1788684176.062818:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073106304:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684176.062915:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073106304:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 99us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684176.062923:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00080000:2.0:1788684176.062973:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684176.064472:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684176.064505:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684176.064542:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684176.064574:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073106688 00000100:00100000:0.0:1788684176.064583:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073106688 00000100:00100000:0.0:1788684176.064648:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:0.0:1788684176.064659:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2389:x1875571073106688:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:0.0:1788684176.064692:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac42c 00000100:00080000:0.0:1788684176.064703:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8d664789b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684176.064755:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788684176.065004:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+2:2389:x1875571073106688:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 345us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684176.065012:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00010000:00010000:0.0:1788684176.065042:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788684176.065050:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684176.067685:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073106176 00000100:00100000:3.0:1788684176.067705:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073106176 00000100:00100000:3.0:1788684176.067777:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073106432 00000100:00100000:3.0:1788684176.067781:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073106432 00000100:00100000:3.0:1788684176.067811:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00100000:3.0:1788684176.068285:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073106176:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684176.068407:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073106176:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 585us (3945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684176.068417:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00100000:2.0:1788684176.068611:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 154 00000100:00100000:2.0:1788684176.068624:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073106432:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684176.068657:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073106432:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (4151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684176.068665:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 154 00000100:00080000:0.0:1788684176.069545:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788684177.022846:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684177.534538:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085762944:0@lo:400:kworker.0 00000100:00100000:1.0:1788684177.534636:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684177.534722:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684177.534730:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085763072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684177.534768:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684177.534812:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085762944 00000100:00100000:1.0:1788684177.534820:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085762944 00000100:00100000:1.0:1788684177.534885:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788684177.534895:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085762944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684177.534964:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085762944:12345-0@lo:400:kworker.0 Request processed in 59us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684177.534971:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788684177.535011:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085763072 00000100:00100000:1.0:1788684177.535015:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085763072 00000100:00100000:0.0:1788684177.535480:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085763200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684177.535520:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684177.536336:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085763584:0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.536403:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684177.536444:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684177.536450:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085763456:0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.536474:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684177.536511:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085763584 00000100:00100000:0.0:1788684177.536518:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085763584 00000100:00100000:0.0:1788684177.536567:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788684177.536578:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085763584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.536631:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085763584:12345-0@lo:400:kworker.0 Request processed in 56us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684177.536638:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788684177.536666:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085763456 00000100:00100000:0.0:1788684177.536670:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085763456 00000100:00100000:1.0:1788684177.536671:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085763200 00000100:00100000:1.0:1788684177.536677:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085763200 00000100:00100000:1.0:1788684177.536699:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788684177.536705:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085763072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684177.536742:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684177.536779:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085763072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684177.536786:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788684177.536800:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788684177.536806:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085763200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788684177.536815:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684177.536843:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085763200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684177.536850:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788684177.536884:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085763968:0@lo:400:kworker.0 00000100:00100000:1.0:1788684177.536913:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684177.536944:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085764480:0@lo:400:kworker.0 00000100:00100000:1.0:1788684177.536982:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684177.537048:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085763968 00000100:00100000:2.0:1788684177.537052:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085763968 00000100:00100000:2.0:1788684177.537091:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788684177.537099:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085763968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.537139:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085763968:12345-0@lo:400:kworker.0 Request processed in 41us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684177.537146:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788684177.537254:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788684177.537262:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085763456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.537298:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085763456:12345-0@lo:400:kworker.0 Request processed in 37us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684177.537306:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1788684177.537427:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684177.537433:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684177.537444:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085763328:0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.537472:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684177.537522:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085763840:0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.537561:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684177.537606:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085764352:0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.537628:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684177.537645:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788684177.537651:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085763712:0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.537679:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788684177.537804:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647959880 x1875571085763072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684177.537837:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085763072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684177.537858:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085762944:0@lo:400:kworker.0 00010000:00080000:1.0:1788684177.537894:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d33100 x1875571085763968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684177.537904:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085763968:0@lo:400:kworker.0 00000100:00100000:1.0:1788684177.537914:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684177.537922:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085764096:0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.537947:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085764224:0@lo:400:kworker.0 00000100:00100000:1.0:1788684177.537969:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684177.538001:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085764480 00000100:00100000:0.0:1788684177.538007:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085764480 00000100:00100000:0.0:1788684177.538043:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085764352 00000100:00100000:0.0:1788684177.538046:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085764352 00000100:00100000:0.0:1788684177.538066:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788684177.538073:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085764480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.538112:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085764480:12345-0@lo:400:kworker.0 Request processed in 39us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684177.538119:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788684177.538132:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788684177.538138:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085764352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.538170:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085764352:12345-0@lo:400:kworker.0 Request processed in 33us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684177.538177:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788684177.538194:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085763712 00000100:00100000:0.0:1788684177.538198:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085763712 00000100:00100000:0.0:1788684177.538221:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788684177.538227:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085763712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.538259:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085763712:12345-0@lo:400:kworker.0 Request processed in 32us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684177.538265:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1788684177.538286:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788684177.538313:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677718e680 x1875571085763200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684177.538341:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085763200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684177.538428:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085763328 00000100:00100000:2.0:1788684177.538433:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085763328 00000100:00100000:2.0:1788684177.538461:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085763840 00000100:00100000:2.0:1788684177.538485:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085763840 00000100:00100000:2.0:1788684177.538511:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788684177.538518:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085763328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.538557:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085763328:12345-0@lo:400:kworker.0 Request processed in 39us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684177.538563:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788684177.538576:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788684177.538583:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085763840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.538609:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085763840:12345-0@lo:400:kworker.0 Request processed in 27us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684177.538616:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00010000:00080000:1.0:1788684177.538760:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa81500 x1875571085764480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684177.538772:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085764480:0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.538830:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085764096 00000100:00100000:1.0:1788684177.538832:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085763456:0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.538835:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085764096 00000100:00100000:1.0:1788684177.538852:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085763584:0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.538870:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788684177.538878:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085764096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684177.538887:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684177.538921:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085763328:0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.538931:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085764096:12345-0@lo:400:kworker.0 Request processed in 53us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684177.538937:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085763840:0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.538943:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00080000:1.0:1788684177.538967:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa82d80 x1875571085764352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684177.538969:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085764224 00000100:00100000:2.0:1788684177.538974:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085764224 00000100:00100000:1.0:1788684177.538983:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085764352:0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.539005:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788684177.539016:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085763712:0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.539017:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085764224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684177.539048:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085764224:12345-0@lo:400:kworker.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684177.539054:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1788684177.539099:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684177.539103:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788684177.539746:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa82300 x1875571085764224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684177.539757:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085764224:0@lo:400:kworker.0 00000100:00100000:0.0:1788684177.539838:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085764096:0@lo:400:kworker.0 00000100:00100000:1.0:1788684178.045607:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085764608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684178.045678:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684178.045745:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085764608 00000100:00100000:1.0:1788684178.045752:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085764608 00000100:00100000:1.0:1788684178.045796:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788684178.045804:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677e70cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085764608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684178.045844:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684178.045901:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677e70cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085764608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684178.045909:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1788684178.046119:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664795bb80 x1875571085764608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684178.046137:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085764608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788684178.046657:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684178.047239:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085764736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684178.047289:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684178.047336:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684178.047353:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085764864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684178.047406:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684178.047497:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085764864 00000100:00100000:3.0:1788684178.047504:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085764864 00000100:00100000:3.0:1788684178.047558:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788684178.047566:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085764864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684178.047593:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788684178.047637:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085764864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684178.047643:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788684178.047681:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085764864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684178.047856:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085764736 00000100:00100000:0.0:1788684178.047861:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085764736 00000100:00100000:0.0:1788684178.047897:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788684178.047904:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085764736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684178.047919:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684178.047978:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085764736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684178.047986:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1788684178.048106:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664787df80 x1875571085764736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684178.048119:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085764736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684178.557654:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684178.557688:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085764992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684178.557769:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684178.558753:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085764992 00000100:00100000:1.0:1788684178.558763:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085764992 00000100:00100000:1.0:1788684178.568516:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788684178.568540:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085764992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684178.568595:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788684178.568687:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085764992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (10917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684178.568694:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788684178.568921:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085764992:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788684179.072494:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788684179.649070:0:13015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788684180.093865:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684181.121788:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684181.185658:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684181.185696:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684181.185722:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684181.185744:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684181.185767:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684181.185793:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073107072 00000100:00100000:3.0:1788684181.185802:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073107072 00000100:00100000:3.0:1788684181.185865:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073107328 00000100:00100000:3.0:1788684181.185869:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073107328 00000100:00100000:3.0:1788684181.185884:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073106944 00000100:00100000:3.0:1788684181.185887:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073106944 00000100:00100000:3.0:1788684181.185899:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073107200 00000100:00100000:3.0:1788684181.185901:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073107200 00000100:00100000:3.0:1788684181.185917:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 161 00000100:00100000:3.0:1788684181.185926:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073107072:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684181.186178:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073106816 00000100:00100000:2.0:1788684181.186183:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073106816 00000100:00100000:2.0:1788684181.186355:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 309 00000100:00100000:2.0:1788684181.186447:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073106816:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684181.186517:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073106816:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 154us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684181.186525:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 309 00000100:00100000:3.0:1788684181.187171:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073107072:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 1244us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684181.187179:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 161 00000100:00100000:3.0:1788684181.187199:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 162 00000100:00100000:3.0:1788684181.187207:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073107328:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684181.187233:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073107328:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 28us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684181.187239:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 162 00000100:00100000:3.0:1788684181.187251:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 163 00000100:00100000:3.0:1788684181.187257:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073106944:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684181.187279:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073106944:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684181.187285:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 163 00000100:00100000:3.0:1788684181.187293:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:3.0:1788684181.187298:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073107200:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684181.187320:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073107200:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 21us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684181.187325:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00080000:3.0:1788684181.187351:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684181.187356:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1788684182.145457:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000020:00000080:0.0:1788684182.145466:0:9488:0:(genops.c:885:class_export_put()) final put ffff8d664789e800/be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000020:00000080:0.0:1788684182.145491:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664789e800/be304e4e-7c60-433e-98d3-9fc97bdb0b28 for lustre-OST0001 00000020:00000080:0.0:1788684182.145532:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664789b000 for lustre-OST0001 00000001:00100000:0.0:1788684182.145820:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000020:00000080:0.0:1788684182.145825:0:8406:0:(genops.c:885:class_export_put()) final put ffff8d664789a000/be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000020:00000080:0.0:1788684182.145844:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664789a000/be304e4e-7c60-433e-98d3-9fc97bdb0b28 for lustre-OST0000 00000020:00000080:0.0:1788684182.145867:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664789f000 for lustre-OST0000 00010000:00010000:1.0:1788684182.150261:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684182.659105:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085765120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684182.659174:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.659243:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085765248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684182.659271:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.659312:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085765120 00000100:00100000:2.0:1788684182.659319:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085765120 00000100:00100000:2.0:1788684182.659361:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085765248 00000100:00100000:2.0:1788684182.659381:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085765248 00000100:00100000:2.0:1788684182.659404:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788684182.659412:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085765120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684182.659438:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684182.659482:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085765120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.659489:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788684182.659508:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788684182.659514:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085765248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684182.659535:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684182.659568:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085765248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.659574:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788684182.659595:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788684182.659622:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664787c380 x1875571085765120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684182.659640:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085765120:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788684182.659671:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa82300 x1875571085765248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684182.659683:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085765248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684182.664742:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085765376:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.664810:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.664859:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085765888:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.664887:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.664910:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085766400:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.664946:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.664973:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788684182.664979:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085765760:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665002:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.665019:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085766272:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665039:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.665067:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085765504:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665104:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.665125:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085766016:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665146:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.665163:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085766528:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665182:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.665201:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788684182.665207:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085765632:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665226:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.665243:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085766144:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665261:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.665271:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085766656:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665291:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.665324:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085765888 00000100:00100000:2.0:1788684182.665330:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085765888 00000100:00100000:2.0:1788684182.665394:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085765632 00000100:00100000:2.0:1788684182.665398:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085765632 00000100:00100000:2.0:1788684182.665415:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788684182.665423:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085765888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665476:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085765888:12345-0@lo:400:kworker.0 Request processed in 53us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.665483:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788684182.665500:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788684182.665507:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085765632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665540:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085765632:12345-0@lo:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.665547:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788684182.665572:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085766400 00000100:00100000:2.0:1788684182.665575:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085766400 00000100:00100000:2.0:1788684182.665606:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085765760 00000100:00100000:2.0:1788684182.665609:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085765760 00000100:00100000:2.0:1788684182.665622:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085766272 00000100:00100000:2.0:1788684182.665625:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085766272 00000100:00100000:2.0:1788684182.665637:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085765504 00000100:00100000:2.0:1788684182.665639:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085765504 00000100:00100000:2.0:1788684182.665649:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085766016 00000100:00100000:2.0:1788684182.665651:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085766016 00000100:00100000:2.0:1788684182.665661:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085766144 00000100:00100000:2.0:1788684182.665664:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085766144 00000100:00100000:2.0:1788684182.665678:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788684182.665683:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085766400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665716:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085766400:12345-0@lo:400:kworker.0 Request processed in 33us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.665723:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788684182.665736:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788684182.665742:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085765760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665770:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085765760:12345-0@lo:400:kworker.0 Request processed in 28us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.665776:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788684182.665788:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788684182.665794:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085766272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665823:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085766272:12345-0@lo:400:kworker.0 Request processed in 29us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.665829:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788684182.665841:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788684182.665847:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085765504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665882:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085765504:12345-0@lo:400:kworker.0 Request processed in 36us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.665889:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788684182.665902:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788684182.665908:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085766016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.665951:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085766016:12345-0@lo:400:kworker.0 Request processed in 42us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.665957:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788684182.665969:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788684182.665976:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085766144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.666004:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085766144:12345-0@lo:400:kworker.0 Request processed in 29us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.666010:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788684182.666045:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085766528 00000100:00100000:2.0:1788684182.666049:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085766528 00000100:00100000:3.0:1788684182.666166:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085765376 00000100:00100000:3.0:1788684182.666170:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085765376 00000100:00100000:3.0:1788684182.666200:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788684182.666207:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085765376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684182.666248:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085765376:12345-0@lo:400:kworker.0 Request processed in 41us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684182.666255:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788684182.668675:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085766656 00000100:00100000:2.0:1788684182.668689:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085766656 00000100:00100000:0.0:1788684182.670330:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788684182.672805:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085766528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684182.672896:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085766528:12345-0@lo:400:kworker.0 Request processed in 2555us (7712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684182.672907:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788684182.672951:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788684182.672960:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085766656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684182.672990:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085766656:12345-0@lo:400:kworker.0 Request processed in 33us (7698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684182.672996:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788684182.673226:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684182.673232:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684182.673235:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684182.673273:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085765632:0@lo:400:kworker.0 00010000:00080000:2.0:1788684182.673289:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66477efb80 x1875571085766144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684182.673299:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085766144:0@lo:400:kworker.0 00010000:00080000:2.0:1788684182.673309:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d30e00 x1875571085766656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684182.673334:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085766656:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.673348:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085765504:0@lo:400:kworker.0 00000100:00100000:2.0:1788684182.673359:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085766016:0@lo:400:kworker.0 00010000:00080000:2.0:1788684182.673405:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d32680 x1875571085766528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684182.673414:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085766528:0@lo:400:kworker.0 00000100:00100000:0.0:1788684182.673454:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085765760:0@lo:400:kworker.0 00000100:00100000:0.0:1788684182.673542:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085766272:0@lo:400:kworker.0 00000100:00100000:0.0:1788684182.673565:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085765376:0@lo:400:kworker.0 00000100:00100000:0.0:1788684182.673577:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085765888:0@lo:400:kworker.0 00010000:00080000:0.0:1788684182.673591:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d31f80 x1875571085766400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684182.673601:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085766400:0@lo:400:kworker.0 00000020:00000080:2.0:1788684182.919498:0:13163:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8405e120 20000000:00000080:2.0:1788684182.919516:0:13163:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d677cc63800 uarg=0000000000000000 20000000:01000000:2.0:1788684182.919559:0:13163:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788684182.919565:0:13163:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788684182.919569:0:13163:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788684182.925358:0:13164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788684182.925499:0:13163:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788684182.932400:0:13163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788684182.932599:0:13163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.932621:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac3c3 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.932629:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac3d1 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.932636:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac3df expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.932667:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac3ed expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.932677:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed397a expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.932684:0:13163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b9 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.932693:0:13163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.932743:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b9 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.932758:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b9 expref: 12 pid: 6489 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684182.932776:0:13163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085766784:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684182.933242:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed397a expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.933252:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed397a expref: 12 pid: 6491 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684182.933261:0:13163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085766912:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684182.933295:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac3ed expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.933315:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac3ed expref: 23 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684182.933325:0:13163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085767040:0@lo:104: 00000100:00100000:1.0:1788684182.933446:0:13163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684182.933494:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac3df expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.933503:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac3df expref: 23 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684182.933512:0:13163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085767168:0@lo:104: 00000100:00100000:1.0:1788684182.933534:0:13163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684182.933560:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac3d1 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.933568:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac3d1 expref: 23 pid: 6491 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684182.933577:0:13163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085767296:0@lo:104: 00000100:00100000:1.0:1788684182.933599:0:13163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684182.933622:0:13163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac3c3 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.933631:0:13163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac3c3 expref: 23 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684182.933639:0:13163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085767424:0@lo:104: 00000100:00100000:1.0:1788684182.933668:0:13163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684182.933695:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085767040 00000100:00100000:1.0:1788684182.933702:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085767040 00000100:00100000:1.0:1788684182.933741:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085767168 00000100:00100000:1.0:1788684182.933743:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085767168 00000100:00100000:1.0:1788684182.933754:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085767296 00000100:00100000:1.0:1788684182.933756:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085767296 00000100:00100000:1.0:1788684182.933765:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085767424 00000100:00100000:1.0:1788684182.933767:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085767424 00000100:00100000:1.0:1788684182.933779:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788684182.933802:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:13163:x1875571085767040:12345-0@lo:104: 00010000:00010000:1.0:1788684182.933817:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.933880:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788684182.933886:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:13163:x1875571085767040:12345-0@lo:104: Request processed in 100us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684182.933893:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788684182.933910:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788684182.933916:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:13163:x1875571085767168:12345-0@lo:104: 00010000:00010000:1.0:1788684182.933937:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684182.933972:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788684182.933977:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:13163:x1875571085767168:12345-0@lo:104: Request processed in 62us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684182.933985:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788684182.934004:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788684182.934011:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:13163:x1875571085767296:12345-0@lo:104: 00000100:00100000:0.0:1788684182.934130:0:10374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684182.934141:0:10374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:13163:x1875571085767424:12345-0@lo:104: 00010000:00010000:0.0:1788684182.934151:0:10374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684182.934159:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684182.934168:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684182.934177:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030600 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684182.934182:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934194:0:10374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788684182.934201:0:10374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:13163:x1875571085767424:12345-0@lo:104: Request processed in 64us (532us total) trans 0 rc 0/0 00010000:00010000:3.0:1788684182.934208:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684182.934209:0:10374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 10000000:00010000:3.0:1788684182.934224:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934230:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:3.0:1788684182.934231:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684182.934238:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934249:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740031400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684182.934252:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934260:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684182.934269:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684182.934270:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684182.934278:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1788684182.934287:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788684182.934305:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934308:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684182.934315:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740030600/0x44bac02bd54ac3ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934319:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684182.934333:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684182.934334:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684182.934346:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740031400/0x44bac02bd54ac3df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3e6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684182.934352:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934358:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684182.934362:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684182.934388:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477ffe00 already unused, calling callback (ffffffffc1297c20) 00010000:00010000:0.0:1788684182.934388:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788684182.934395:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684182.934403:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684182.934410:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085767680:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1788684182.934411:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684182.934421:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788684182.934445:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684182.934449:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684182.934458:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684182.934472:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684182.934481:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477ffe00/0x44bac02bd54ac3c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684182.934481:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684182.934491:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085767552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684182.934495:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684182.934499:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684182.934502:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684182.934518:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684182.934562:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085767680 00000100:00100000:0.0:1788684182.934566:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085767680 00010000:00010000:0.0:1788684182.934586:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac3df expref: 24 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684182.934607:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085767552 00000100:00100000:0.0:1788684182.934610:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085767552 00010000:00010000:0.0:1788684182.934620:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac3ed expref: 25 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684182.934649:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684182.934656:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+25:3624:x1875571085767680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684182.934666:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684182.934672:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac3df expref: 25 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934681:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac3df expref: 25 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934696:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684182.934723:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+25:3624:x1875571085767680:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684182.934729:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684182.934742:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684182.934748:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085767552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684182.934755:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684182.934759:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac3ed expref: 24 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934768:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac3ed expref: 24 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.934777:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684182.934799:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085767552:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684182.934805:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684182.934839:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085767552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684182.934874:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085767680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684182.934994:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085767808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684182.935020:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.935065:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085767808 00000100:00100000:2.0:1788684182.935069:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085767808 00010000:00010000:2.0:1788684182.935084:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac3c3 expref: 24 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684182.935103:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684182.935109:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085767808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684182.935116:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684182.935120:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac3c3 expref: 24 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684182.935135:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac3c3 expref: 24 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684182.935145:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684182.935172:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085767808:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.935179:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684182.935209:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085767808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684182.935446:0:13163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664186bf00 going to sleep for 11 seconds 00010000:00010000:2.0:1788684182.935464:0:13163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477ff400/0x44bac02bd54ac3f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac3ed expref: 23 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684182.935474:0:13163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085767040:0@lo:104: 00010000:00010000:2.0:1788684182.935485:0:13163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740031800/0x44bac02bd54ac3e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac3df expref: 22 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684182.935493:0:13163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085767168:0@lo:104: 00010000:00010000:2.0:1788684182.935502:0:13163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477ff200/0x44bac02bd54ac3ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac3c3 expref: 21 pid: 6490 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684182.935509:0:13163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085767424:0@lo:104: 00010000:00010000:1.0:1788684182.938358:0:6481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684182.938439:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684182.938505:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788684182.938517:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:13163:x1875571085767296:12345-0@lo:104: Request processed in 4503us (4913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684182.938528:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684182.938545:0:13163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085767296:0@lo:104: 00010000:00010000:0.0:1788684182.938593:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684182.938601:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.938608:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684182.938613:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.938622:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684182.938629:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684182.938635:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684182.938685:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.938692:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684182.938721:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.938729:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740030800/0x44bac02bd54ac3d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac3d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.938748:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684182.938750:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684182.938752:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684182.938760:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684182.938787:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085767936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684182.939244:0:13163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085766784:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684182.939254:0:13163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13163:1875571085766912:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684182.939299:0:13163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684182.939346:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684182.939537:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085767936 00000100:00100000:2.0:1788684182.939544:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085767936 00010000:00010000:2.0:1788684182.939569:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac3d1 expref: 21 pid: 6491 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684182.939603:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788684182.939612:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3625:x1875571085767936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684182.939623:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684182.939628:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac3d1 expref: 21 pid: 6491 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684182.939637:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac3d1 expref: 21 pid: 6491 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684182.939651:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740031600/0x44bac02bd54ac3d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac3d1 expref: 21 pid: 6491 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684182.939664:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684182.939711:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:3625:x1875571085767936:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684182.939718:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788684182.939801:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085767936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684182.942836:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684182.942883:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684182.942953:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073107456 00000100:00100000:0.0:1788684182.942963:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073107456 00010000:00010000:0.0:1788684182.942999:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b9 expref: 13 pid: 6489 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684182.943041:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073107584 00000100:00100000:0.0:1788684182.943045:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073107584 00010000:00010000:0.0:1788684182.943057:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed397a expref: 14 pid: 6491 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684182.943086:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:0.0:1788684182.943095:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+14:2392:x1875571073107456:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684182.943109:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684182.943114:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b9 expref: 14 pid: 6489 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943124:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b9 expref: 14 pid: 6489 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943152:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711de00/0x44bac02bd54ac410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b9 expref: 14 pid: 6489 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943167:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684182.943224:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073107456:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 130us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684182.943232:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:0.0:1788684182.943249:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:0.0:1788684182.943268:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+12:2392:x1875571073107584:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684182.943276:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684182.943280:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed397a expref: 12 pid: 6491 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943289:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed397a expref: 12 pid: 6491 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943300:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030000/0x44bac02bd54ac3fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed397a expref: 12 pid: 6491 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943312:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943320:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943335:0:9510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943342:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943349:0:9510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943355:0:9510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943361:0:9510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684182.943394:0:9510:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943408:0:9510:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943421:0:9510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684182.943431:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684182.943451:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+11:2392:x1875571073107584:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 184us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684182.943458:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00010000:00010000:2.0:1788684182.943887:0:13163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684182.943896:0:13163:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684182.943913:0:13163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a0800/0x44bac02bd54ac433 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684183.170451:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085768064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684183.170522:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684183.170601:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085768064 00000100:00100000:0.0:1788684183.170619:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085768064 00000100:00100000:0.0:1788684183.170667:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788684183.170675:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085768064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684183.170701:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684183.170743:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085768064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684183.170749:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788684183.171461:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a83100 x1875571085768064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684183.171481:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085768064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788684183.176998:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684183.182245:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085768320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684183.182310:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684183.182403:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085768320 00000100:00100000:0.0:1788684183.182410:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085768320 00000100:00100000:0.0:1788684183.182451:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788684183.182460:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085768320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788684183.182488:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788684183.182536:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085768320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684183.182542:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788684183.182581:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085768320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684183.182598:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684183.182605:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085768192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684183.182627:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684183.182656:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085768192 00000100:00100000:0.0:1788684183.182660:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085768192 00000100:00100000:0.0:1788684183.182684:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788684183.182691:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085768192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684183.182703:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684183.182735:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085768192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684183.182741:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788684183.182769:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a83100 x1875571085768192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684183.182782:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085768192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684183.678091:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085768448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684183.678165:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684183.678461:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085768448 00000100:00100000:3.0:1788684183.678469:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085768448 00000100:00100000:3.0:1788684183.678522:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788684183.678531:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085768448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684183.678571:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788684183.678627:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085768448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684183.678633:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788684183.678729:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085768448:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684184.203895:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788684184.445856:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788684184.445866:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67771bc800 from 7 10000000:01000000:1.0:1788684184.445872:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788684184.445947:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684184.445961:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684184.445975:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684184.446139:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085768576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788684184.446235:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684184.446306:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664186b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788684184.446932:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085768576 00000100:00100000:2.0:1788684184.446943:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085768576 00000100:00100000:2.0:1788684184.447082:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788684184.447094:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085768576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684184.447112:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684184.447132:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac43a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.447161:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac43a expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.447172:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac43a expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.447183:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477ff600, rc 0) 00000100:00100000:2.0:1788684184.447255:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085768576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684184.447262:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788684184.447629:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085768576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684184.447651:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.447662:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684184.448125:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085768704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684184.448176:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684184.448222:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684184.448443:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085768704 00000100:00100000:1.0:1788684184.448450:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085768704 00000100:00100000:1.0:1788684184.448505:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788684184.448515:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085768704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684184.448663:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085768704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684184.448684:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788684184.450150:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085768704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684184.450227:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085768832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684184.450308:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684184.451811:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664186be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684184.454687:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085768832 00000100:00100000:3.0:1788684184.454706:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085768832 00000100:00100000:2.0:1788684184.455254:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788684184.455267:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085768832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.455503:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085768832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (5193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684184.455518:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788684184.455747:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085768832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788684184.457209:0:13194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788684184.461628:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788684184.461695:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684184.461722:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.461740:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684184.461755:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684184.461759:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677e122800 from 7 10000000:01000000:2.0:1788684184.461763:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684184.461817:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.461826:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.461838:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684184.461869:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085768960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.461965:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684184.462206:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684184.464991:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085768960 00000100:00100000:3.0:1788684184.465014:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085768960 00000100:00100000:2.0:1788684184.467476:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788684184.467493:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085768960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684184.467516:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684184.467539:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac448 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.467592:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac448 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.467605:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac448 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.467616:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477ffe00, rc 0) 00000100:00100000:2.0:1788684184.468860:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085768960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1362us (6885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684184.468872:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788684184.469393:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085768960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684184.469428:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684184.469442:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684184.469548:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.469610:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684184.469646:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647707000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684184.469761:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085769088 00000100:00100000:0.0:1788684184.469770:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085769088 00000100:00100000:0.0:1788684184.469825:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788684184.469836:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085769088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684184.469995:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085769088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684184.470003:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788684184.470243:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.470285:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.470342:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684184.470397:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647707000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684184.470508:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085769216 00000100:00100000:0.0:1788684184.470513:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085769216 00000100:00100000:0.0:1788684184.470547:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788684184.470554:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085769216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684184.470730:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085769216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684184.470737:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788684184.470935:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788684184.472011:0:13195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788684184.472255:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788684184.472288:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684184.472302:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.472314:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684184.472328:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684184.472331:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677cc6f800 from 7 10000000:01000000:2.0:1788684184.472334:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684184.472398:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.472406:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.472417:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684184.472453:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.472519:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684184.472577:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684184.472726:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085769344 00000100:00100000:0.0:1788684184.472735:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085769344 00000100:00100000:0.0:1788684184.472789:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788684184.472808:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085769344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684184.472824:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684184.472839:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac456 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.472866:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac456 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.472878:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac456 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.472890:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d676d811200, rc 0) 00000100:00100000:0.0:1788684184.472952:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085769344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684184.472960:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788684184.473402:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684184.473420:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684184.473430:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684184.473500:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.473534:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684184.473561:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647707d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684184.473616:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085769472 00000100:00100000:2.0:1788684184.473622:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085769472 00000100:00100000:2.0:1788684184.473650:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788684184.473658:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085769472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.473813:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085769472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684184.473820:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788684184.473885:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.473926:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.473969:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684184.473990:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647707d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684184.474030:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085769600 00000100:00100000:2.0:1788684184.474033:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085769600 00000100:00100000:2.0:1788684184.474063:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788684184.474070:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085769600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.474163:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085769600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684184.474169:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788684184.474361:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788684184.475428:0:13196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788684184.475929:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788684184.475957:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684184.475970:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.475983:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684184.475994:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684184.476014:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67466b4800 from 7 10000000:01000000:2.0:1788684184.476017:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684184.476075:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.476082:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.476093:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684184.476208:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.476278:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684184.476391:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684184.478852:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085769728 00000100:00100000:0.0:1788684184.478871:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085769728 00000100:00100000:0.0:1788684184.479229:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788684184.479241:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085769728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684184.479262:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684184.479284:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac464 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.479316:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac464 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.479328:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac464 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.479358:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d676d811800, rc 0) 00000100:00100000:0.0:1788684184.479470:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085769728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (3192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684184.479477:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788684184.479598:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684184.479621:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.479631:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684184.479735:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.479776:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684184.479816:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788684184.479957:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085769856 00000100:00100000:3.0:1788684184.479963:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085769856 00000100:00100000:3.0:1788684184.480003:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788684184.480011:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085769856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.480319:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085769856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684184.480327:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788684184.480413:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.480447:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.480493:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684184.480520:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684184.480688:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085769984 00000100:00100000:0.0:1788684184.480694:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085769984 00000100:00100000:0.0:1788684184.480738:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788684184.480746:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085769984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684184.480834:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085769984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684184.480841:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788684184.481019:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085769984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788684184.483173:0:13197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788684184.483548:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788684184.483579:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684184.483592:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684184.483605:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684184.826654:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684184.826755:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073107712 00000100:00100000:0.0:1788684184.826766:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073107712 00000100:00100000:0.0:1788684184.826833:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 323 00000100:00100000:0.0:1788684184.826846:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+11:6161:x1875571073107712:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684184.826867:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684184.826887:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed39ea expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.826933:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ea expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.826946:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ea expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684184.826956:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d676d810000, rc 0) 00000100:00100000:0.0:1788684184.827042:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073107712:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 198us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684184.827049:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 323 00000100:00100000:0.0:1788684184.843196:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684184.843909:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073107840 00000100:00100000:2.0:1788684184.843933:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073107840 00000100:00100000:2.0:1788684184.844004:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 324 00000100:00100000:2.0:1788684184.844017:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073107840:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684184.844482:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073107840:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 466us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684184.844492:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 324 00000100:00100000:1.0:1788684184.854501:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684184.856899:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073107968 00000100:00100000:3.0:1788684184.856928:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073107968 00000100:00100000:3.0:1788684184.857029:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 325 00000100:00100000:3.0:1788684184.857583:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073107968:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.857776:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073107968:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 736us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684184.857856:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 325 00000100:00100000:1.0:1788684184.866766:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684184.869221:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073108096 00000100:00100000:3.0:1788684184.869240:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073108096 00000100:00100000:3.0:1788684184.869401:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 326 00000100:00100000:3.0:1788684184.869414:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073108096:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684184.869436:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684184.869465:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed39f1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684184.869514:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f1 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684184.869526:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f1 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684184.869538:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c600, rc 0) 00000100:00100000:3.0:1788684184.869624:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073108096:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 213us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684184.869631:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 326 00000100:00100000:0.0:1788684184.885686:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684184.888169:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073108224 00000100:00100000:3.0:1788684184.888190:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073108224 00000100:00100000:3.0:1788684184.888336:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 327 00000100:00100000:3.0:1788684184.888349:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073108224:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.889194:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073108224:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 842us (3516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684184.889206:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 327 00000100:00100000:1.0:1788684184.894353:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684184.895267:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073108352 00000100:00100000:3.0:1788684184.895284:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073108352 00000100:00100000:3.0:1788684184.895443:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 328 00000100:00100000:3.0:1788684184.895457:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073108352:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684184.895811:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073108352:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 355us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684184.895820:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 328 00010000:00010000:3.0:1788684185.213526:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684186.237526:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684186.297793:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684186.297955:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684186.297982:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684186.298002:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684186.298017:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073108480 00000100:00100000:3.0:1788684186.298024:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684186.298026:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073108480 00000100:00100000:3.0:1788684186.298043:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073108736 00000100:00100000:3.0:1788684186.298047:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073108736 00000100:00100000:0.0:1788684186.298072:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 329 00000100:00100000:3.0:1788684186.298078:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073108992 00000100:00100000:3.0:1788684186.298080:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073108992 00000100:00100000:0.0:1788684186.298081:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073108480:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684186.298091:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073108608 00000100:00100000:3.0:1788684186.298093:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073108608 00000100:00100000:3.0:1788684186.298102:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073108864 00000100:00100000:3.0:1788684186.298104:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073108864 00000100:00100000:3.0:1788684186.298115:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 171 00000100:00100000:3.0:1788684186.298121:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073108736:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684186.298148:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073108736:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684186.298148:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073108480:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 68us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684186.298155:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 329 00000100:00100000:3.0:1788684186.298161:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 171 00000100:00100000:3.0:1788684186.298173:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 172 00000100:00100000:3.0:1788684186.298179:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073108992:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684186.298202:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073108992:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684186.298208:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 172 00000100:00100000:3.0:1788684186.298219:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 173 00000100:00100000:3.0:1788684186.298225:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073108608:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684186.298248:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073108608:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684186.298254:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 173 00000100:00100000:3.0:1788684186.298265:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 174 00000100:00100000:3.0:1788684186.298271:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073108864:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684186.298297:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073108864:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684186.298304:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 174 00000100:00080000:3.0:1788684186.298327:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684186.298330:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788684187.270284:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788684187.374035:0:13362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788684187.773622:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788684187.773644:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085770112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684187.773708:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684187.773774:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085770240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684187.773792:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085770496:0@lo:400:kworker.0 00000100:00100000:1.0:1788684187.773797:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684187.773815:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085770752:0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.773821:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684187.773886:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085770624:0@lo:400:kworker.0 00000100:00100000:3.0:1788684187.773941:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085770368:0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.775240:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085771008:0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.775284:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684187.775314:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085771520:0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.775335:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684187.775394:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085770496 00000100:00100000:2.0:1788684187.775412:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085770496 00000100:00100000:2.0:1788684187.775453:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085771008 00000100:00100000:2.0:1788684187.775456:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085771008 00000100:00100000:2.0:1788684187.775479:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085771520 00000100:00100000:2.0:1788684187.775482:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085771520 00000100:00100000:2.0:1788684187.775497:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788684187.775505:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085770496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.775554:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085770496:12345-0@lo:400:kworker.0 Request processed in 50us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.775562:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788684187.775578:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788684187.775584:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085771008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.775610:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085771008:12345-0@lo:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.775616:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788684187.775626:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788684187.775632:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085771520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.775653:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085771520:12345-0@lo:400:kworker.0 Request processed in 22us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.775658:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788684187.775690:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085770496:0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.775700:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085771008:0@lo:400:kworker.0 00010000:00080000:2.0:1788684187.775711:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664787f100 x1875571085771520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684187.775720:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085771520:0@lo:400:kworker.0 00000100:00080000:2.0:1788684187.775783:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684187.775787:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684187.775810:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085770112 00000100:00100000:2.0:1788684187.775814:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085770112 00000100:00100000:2.0:1788684187.775836:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085770240 00000100:00100000:2.0:1788684187.775839:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085770240 00000100:00100000:2.0:1788684187.775852:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788684187.775858:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085770112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684187.775878:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684187.776033:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085770112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.776039:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788684187.776052:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788684187.776059:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085770240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684187.776068:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684187.776092:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085770240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.776097:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788684187.776110:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684187.777314:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684187.777361:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085771264:0@lo:400:kworker.0 00000100:00100000:1.0:1788684187.777414:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788684187.777448:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa71500 x1875571085770112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684187.777466:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085770112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684187.777486:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085771776:0@lo:400:kworker.0 00000100:00100000:1.0:1788684187.777522:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788684187.777544:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d33800 x1875571085770240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684187.777555:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085770240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684187.777759:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085771264 00000100:00100000:1.0:1788684187.777775:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085771264 00000100:00100000:1.0:1788684187.777811:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085771776 00000100:00100000:1.0:1788684187.777814:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085771776 00000100:00100000:2.0:1788684187.777884:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788684187.777894:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085771264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.777952:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085771264:12345-0@lo:400:kworker.0 Request processed in 60us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.777959:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788684187.777975:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788684187.777981:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085771776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.778029:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085771776:12345-0@lo:400:kworker.0 Request processed in 49us (506us total) trans 0 rc 0/0 00000100:00080000:1.0:1788684187.781198:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684187.781220:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788684187.781248:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664787c380 x1875571085771776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684187.781264:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085771776:0@lo:400:kworker.0 00000100:00100000:0.0:1788684187.781276:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085771136:0@lo:400:kworker.0 00010000:00080000:1.0:1788684187.781282:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66477ece00 x1875571085771264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684187.781293:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085771264:0@lo:400:kworker.0 00000100:00100000:0.0:1788684187.781313:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684187.781350:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684187.781351:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664787c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085771648:0@lo:400:kworker.0 00000100:00100000:1.0:1788684187.781449:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085770624 00000100:00100000:1.0:1788684187.781456:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085770624 00000100:00100000:1.0:1788684187.781499:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788684187.781507:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085770624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.781575:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788684187.781604:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085770752 00000100:00100000:2.0:1788684187.781609:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085770752 00000100:00100000:2.0:1788684187.781639:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085771136 00000100:00100000:2.0:1788684187.781643:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085771136 00000100:00100000:3.0:1788684187.781650:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085770880:0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.781675:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788684187.781682:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085770752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.781738:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085770752:12345-0@lo:400:kworker.0 Request processed in 56us (4426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.781744:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788684187.781759:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788684187.781766:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085771136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684187.781818:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684187.781827:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684187.781837:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085770624:12345-0@lo:400:kworker.0 Request processed in 328us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.781839:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085771136:12345-0@lo:400:kworker.0 Request processed in 73us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684187.781852:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788684187.781853:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788684187.781860:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085771392:0@lo:400:kworker.0 00000100:00100000:1.0:1788684187.781873:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085770880 00000100:00100000:0.0:1788684187.781873:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085770624:0@lo:400:kworker.0 00000100:00100000:1.0:1788684187.781879:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085770880 00000100:00100000:2.0:1788684187.781916:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788684187.781922:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684187.781927:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085770880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684187.781965:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085771392 00000100:00100000:3.0:1788684187.781970:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085771392 00000100:00100000:2.0:1788684187.781974:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085770880:12345-0@lo:400:kworker.0 Request processed in 49us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.781981:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788684187.782006:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085770368 00000100:00100000:3.0:1788684187.782007:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788684187.782013:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085770368 00000100:00100000:3.0:1788684187.782018:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085771392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.782044:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00080000:1.0:1788684187.782050:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684187.782055:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085770368:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788684187.782056:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684187.782059:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085771392:12345-0@lo:400:kworker.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684187.782071:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788684187.782092:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085770752:0@lo:400:kworker.0 00000100:00100000:3.0:1788684187.782113:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085770368:0@lo:400:kworker.0 00000100:00100000:2.0:1788684187.782115:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085770368:12345-0@lo:400:kworker.0 Request processed in 61us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684187.782126:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788684187.782132:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085770880:0@lo:400:kworker.0 00000100:00100000:3.0:1788684187.782145:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085771392:0@lo:400:kworker.0 00000100:00100000:1.0:1788684187.782209:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085771648 00000100:00100000:1.0:1788684187.782214:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085771648 00010000:00080000:0.0:1788684187.782322:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647958380 x1875571085771136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684187.782333:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085771136:0@lo:400:kworker.0 00000100:00080000:2.0:1788684187.782334:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684187.782408:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788684187.782417:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085771648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684187.782658:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085771648:12345-0@lo:400:kworker.0 Request processed in 40us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684187.782667:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788684187.782799:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664787c000 x1875571085771648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684187.782810:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664787c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085771648:0@lo:400:kworker.0 00000100:00100000:2.0:1788684188.286086:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085772032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684188.286152:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684188.286215:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684188.286222:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085771904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684188.286247:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684188.286277:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085772032 00000100:00100000:2.0:1788684188.286284:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085772032 00000100:00100000:2.0:1788684188.286318:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085771904 00000100:00100000:2.0:1788684188.286322:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085771904 00000100:00100000:2.0:1788684188.286337:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788684188.286346:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085772032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684188.286401:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684188.286445:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085772032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684188.286453:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788684188.286469:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788684188.286475:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085771904:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684188.286582:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085772160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684188.286627:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788684188.286753:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684188.286790:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085771904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 314us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684188.286797:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788684188.286832:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a80380 x1875571085771904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684188.286851:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085771904:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788684188.286862:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6775ef5500 x1875571085772032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684188.286872:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085772032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684188.287858:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085772160 00000100:00100000:3.0:1788684188.287868:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085772160 00000100:00100000:3.0:1788684188.287924:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788684188.287933:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085772160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684188.287964:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788684188.288021:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085772160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684188.288027:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00010000:3.0:1788684188.288088:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684188.288240:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085772160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684188.797548:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788684188.797569:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085772288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684188.797640:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684188.797758:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085772288 00000100:00100000:1.0:1788684188.797766:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085772288 00000100:00100000:1.0:1788684188.797821:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788684188.797831:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085772288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684188.797862:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788684188.797988:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085772288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684188.797996:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788684188.798410:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085772288:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788684189.319511:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684190.338594:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684191.357489:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684191.418171:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684191.418213:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684191.418247:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684191.418265:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684191.418289:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684191.418317:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073109248 00000100:00100000:3.0:1788684191.418325:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073109248 00000100:00100000:3.0:1788684191.418393:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073109504 00000100:00100000:3.0:1788684191.418396:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073109504 00000100:00100000:3.0:1788684191.418410:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073109376 00000100:00100000:3.0:1788684191.418412:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073109376 00000100:00100000:3.0:1788684191.418422:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073109632 00000100:00100000:3.0:1788684191.418424:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073109632 00000100:00100000:3.0:1788684191.418438:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00100000:3.0:1788684191.418446:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073109248:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684191.418505:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073109248:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 60us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684191.418513:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00100000:3.0:1788684191.418527:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:3.0:1788684191.418533:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073109504:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684191.418556:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073109504:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684191.418562:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:3.0:1788684191.418573:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:3.0:1788684191.418578:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073109376:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684191.418597:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073109376:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 19us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684191.418615:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:3.0:1788684191.418626:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:3.0:1788684191.418632:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073109632:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684191.418652:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073109632:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 20us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684191.418657:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:0.0:1788684191.418940:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073109120 00000100:00100000:0.0:1788684191.418945:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073109120 00000100:00100000:0.0:1788684191.418982:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 331 00000100:00100000:0.0:1788684191.418990:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073109120:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684191.419017:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073109120:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 28us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684191.419023:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 331 00000100:00080000:2.0:1788684191.421116:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684191.421124:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788684192.381499:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788684192.490519:0:13510:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:43:11 (1788684191) === 00000100:00100000:3.0:1788684192.894618:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085772800:0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.894713:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684192.894771:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085773312:0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.894796:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684192.894815:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085773824:0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.894839:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684192.894860:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788684192.894865:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085772672:0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.894910:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684192.894931:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085773184:0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.894951:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684192.894967:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085773696:0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.894987:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684192.895016:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085772800 00000100:00100000:3.0:1788684192.895022:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085772800 00000100:00100000:3.0:1788684192.895058:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085773184 00000100:00100000:3.0:1788684192.895061:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085773184 00000100:00100000:3.0:1788684192.895082:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085773696 00000100:00100000:3.0:1788684192.895096:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085773696 00000100:00100000:3.0:1788684192.895116:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788684192.895124:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085772800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.895171:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085772800:12345-0@lo:400:kworker.0 Request processed in 47us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684192.895178:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788684192.895194:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788684192.895200:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085773184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.895225:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085773184:12345-0@lo:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684192.895231:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788684192.895241:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788684192.895247:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085773696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.895271:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085773696:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684192.895277:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788684192.895293:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085773312 00000100:00100000:3.0:1788684192.895296:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085773312 00000100:00100000:3.0:1788684192.895315:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085773824 00000100:00100000:3.0:1788684192.895317:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085773824 00000100:00100000:3.0:1788684192.895332:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788684192.895338:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085773312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.895397:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085773312:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684192.895403:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788684192.895413:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788684192.895418:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085773824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.895448:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085773824:12345-0@lo:400:kworker.0 Request processed in 30us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684192.895453:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788684192.895469:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085772672 00000100:00100000:3.0:1788684192.895472:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085772672 00000100:00100000:3.0:1788684192.895493:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788684192.895499:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085772672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.895527:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085772672:12345-0@lo:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684192.895533:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788684192.895574:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085772672:0@lo:400:kworker.0 00010000:00080000:3.0:1788684192.895588:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777062680 x1875571085773184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684192.895598:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085773184:0@lo:400:kworker.0 00010000:00080000:3.0:1788684192.895608:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777062d80 x1875571085773696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684192.895616:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085773696:0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.895626:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085772800:0@lo:400:kworker.0 00010000:00080000:3.0:1788684192.895634:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777063b80 x1875571085773312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684192.895641:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085773312:0@lo:400:kworker.0 00010000:00080000:3.0:1788684192.895649:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777063800 x1875571085773824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684192.895668:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085773824:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.895765:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085772416:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.895799:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684192.895836:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085772928:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.895856:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684192.895885:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085773440:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.895905:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684192.895919:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085773952:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.895936:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684192.895951:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788684192.895957:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085772544:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.895975:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684192.895987:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085773056:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896004:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684192.896026:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085773568:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896045:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684192.896064:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085772544 00000100:00100000:0.0:1788684192.896067:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085772544 00000100:00100000:0.0:1788684192.896086:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085773056 00000100:00100000:0.0:1788684192.896089:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085773056 00000100:00100000:0.0:1788684192.896101:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085773568 00000100:00100000:0.0:1788684192.896103:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085773568 00000100:00100000:0.0:1788684192.896116:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788684192.896122:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085772544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896155:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085772544:12345-0@lo:400:kworker.0 Request processed in 33us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684192.896161:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788684192.896172:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788684192.896177:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085773056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896199:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085773056:12345-0@lo:400:kworker.0 Request processed in 22us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684192.896204:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788684192.896212:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788684192.896217:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085773568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896238:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085773568:12345-0@lo:400:kworker.0 Request processed in 20us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684192.896243:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788684192.896257:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085772928 00000100:00100000:0.0:1788684192.896260:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085772928 00000100:00100000:0.0:1788684192.896278:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788684192.896283:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085772928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896317:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085772928:12345-0@lo:400:kworker.0 Request processed in 34us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684192.896323:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788684192.896339:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085773440 00000100:00100000:0.0:1788684192.896341:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085773440 00000100:00100000:0.0:1788684192.896355:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085773952 00000100:00100000:0.0:1788684192.896357:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085773952 00000100:00100000:0.0:1788684192.896396:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788684192.896401:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085773440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896425:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085773440:12345-0@lo:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684192.896431:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788684192.896440:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788684192.896445:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085773952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896465:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085773952:12345-0@lo:400:kworker.0 Request processed in 21us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684192.896470:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788684192.896498:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085772544:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896508:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085773056:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896516:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085773568:0@lo:400:kworker.0 00000100:00100000:0.0:1788684192.896525:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085772928:0@lo:400:kworker.0 00010000:00080000:0.0:1788684192.896533:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777061f80 x1875571085773440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684192.896542:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085773440:0@lo:400:kworker.0 00010000:00080000:0.0:1788684192.896559:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777060700 x1875571085773952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684192.896566:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085773952:0@lo:400:kworker.0 00000100:00080000:2.0:1788684192.896765:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684192.896770:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684192.896772:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684192.896774:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684192.896987:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684192.896997:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085774080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684192.897027:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684192.897054:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085774080 00000100:00100000:2.0:1788684192.897058:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085774080 00000100:00100000:2.0:1788684192.897081:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788684192.897087:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085774080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684192.897115:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684192.897149:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085774080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684192.897155:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1788684192.897180:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664790b800 x1875571085774080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684192.897192:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085774080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684192.897315:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085772416 00000100:00100000:3.0:1788684192.897320:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085772416 00000100:00100000:3.0:1788684192.897354:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788684192.897360:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085772416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684192.897415:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085772416:12345-0@lo:400:kworker.0 Request processed in 55us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684192.897420:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788684192.897616:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085772416:0@lo:400:kworker.0 00000100:00100000:1.0:1788684192.897761:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085774208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684192.897789:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684192.897855:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085774208 00000100:00100000:2.0:1788684192.897859:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085774208 00000100:00100000:2.0:1788684192.897919:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788684192.897926:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085774208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684192.897936:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684192.897973:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085774208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684192.897979:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788684192.898282:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a82680 x1875571085774208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684192.898295:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085774208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684193.017145:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684193.017194:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684193.017415:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073109888 00000100:00100000:1.0:1788684193.017425:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073109888 00000100:00100000:2.0:1788684193.017515:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073109760 00000100:00100000:2.0:1788684193.017520:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073109760 00000100:00100000:1.0:1788684193.017570:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:2.0:1788684193.017571:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1788684193.017583:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073109760:12345-192.168.206.44@tcp:41:mkdir.0 00000100:00100000:1.0:1788684193.017590:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:10488:x1875571073109888:12345-192.168.206.44@tcp:700:mkdir.0 00000004:00000024:2.0:1788684193.017619:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788684193.017664:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:10488:x1875571073109888:12345-192.168.206.44@tcp:700:mkdir.0 Request processed in 81us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684193.017674:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073109760:12345-192.168.206.44@tcp:41:mkdir.0 Request processed in 90us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684193.017675:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:2.0:1788684193.017685:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00080000:3.0:1788684193.024851:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684193.024961:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684193.025122:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073110144 00000100:00100000:1.0:1788684193.025133:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073110144 00000100:00100000:1.0:1788684193.025195:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:1.0:1788684193.025205:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:10488:x1875571073110144:12345-192.168.206.44@tcp:36:mkdir.0 00010000:00010000:1.0:1788684193.025269:0:12443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684193.025497:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac322 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3965 expref: 6 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.025518:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c600) 00010000:00010000:1.0:1788684193.025530:0:12443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684193.025607:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.025620:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.025629:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.025641:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.025647:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.025653:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.027645:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.027663:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.027671:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684193.027695:0:12443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000965871cb reply state 000000000bf66e26 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.027707:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.027714:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182d300) 00010000:00010000:1.0:1788684193.027717:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684193.027720:0:12443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788684193.027725:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788684193.027743:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.027750:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.027758:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.027763:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684193.027767:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.028516:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.028530:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d664182d900) 00010000:00010000:1.0:1788684193.028533:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684193.028536:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.028554:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac480 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684193.028574:0:12443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000965871cb reply state 000000000bf66e26 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.028582:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.028588:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d664182dd00) 00010000:00010000:1.0:1788684193.028590:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684193.028593:0:12443:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788684193.028687:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:10488:x1875571073110144:12345-192.168.206.44@tcp:36:mkdir.0 Request processed in 3480us (3729us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788684193.028696:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:1.0:1788684193.059717:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684193.063931:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073110272 00000100:00100000:3.0:1788684193.063951:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073110272 00000100:00100000:2.0:1788684193.064303:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:2.0:1788684193.064324:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:10489:x1875571073110272:12345-192.168.206.44@tcp:101:chmod.0 00010000:00010000:2.0:1788684193.064344:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684193.064385:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed39f8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.064452:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac49c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.064465:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac49c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.064475:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac49c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684193.064515:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788684193.064518:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684193.064547:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac49c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.064569:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f8 expref: 9 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.064585:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac49c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f8 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.064593:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647575d00) 00010000:00010000:2.0:1788684193.064596:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684193.064599:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4200, rc 0) 00000100:00100000:2.0:1788684193.064658:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:10489:x1875571073110272:12345-192.168.206.44@tcp:101:chmod.0 Request processed in 336us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684193.064682:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:0.0:1788684193.070637:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684193.070999:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073110528 00000100:00100000:3.0:1788684193.071009:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073110528 00000100:00100000:3.0:1788684193.071061:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:3.0:1788684193.071070:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:10489:x1875571073110528:12345-192.168.206.44@tcp:36:chmod.0 00010000:00010000:3.0:1788684193.071137:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684193.071162:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac49c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f8 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.071179:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647575d00) 00010000:00010000:3.0:1788684193.071188:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788684193.071210:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.071222:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.071243:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788684193.071460:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6cd8584 reply state 0000000000c0530d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.071473:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.071479:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6750b6fb00) 00010000:00010000:3.0:1788684193.071482:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788684193.071484:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788684193.071490:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788684193.071566:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:10489:x1875571073110528:12345-192.168.206.44@tcp:36:chmod.0 Request processed in 496us (937us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788684193.071573:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:2.0:1788684193.106179:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684193.106624:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073110656 00000100:00100000:1.0:1788684193.106634:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073110656 00000100:00100000:1.0:1788684193.106692:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:1.0:1788684193.106702:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:10490:x1875571073110656:12345-192.168.206.44@tcp:101:chown.0 00010000:00010000:1.0:1788684193.106721:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684193.106750:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ac4aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed39ff expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.106811:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac4b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.106825:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.106858:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684193.106906:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788684193.106910:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684193.106944:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.106969:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ac4aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ff expref: 11 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.106987:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ff expref: 10 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.106995:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6750b6fb00) 00010000:00010000:1.0:1788684193.106997:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788684193.107001:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0a00, rc 0) 00000100:00100000:1.0:1788684193.107059:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:10490:x1875571073110656:12345-192.168.206.44@tcp:101:chown.0 Request processed in 358us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684193.107066:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:1.0:1788684193.113553:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684193.113639:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073110784 00000100:00100000:0.0:1788684193.113649:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073110784 00000100:00100000:0.0:1788684193.113702:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:0.0:1788684193.113712:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:10490:x1875571073110784:12345-192.168.206.44@tcp:101:chown.0 00010000:00010000:0.0:1788684193.113730:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684193.113764:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac4b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a06 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.113824:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.113838:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.113860:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.113899:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.113906:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.113913:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.113991:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac4cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.113999:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114006:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684193.114045:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788684193.114048:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684193.114066:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114077:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114083:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114090:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114117:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684193.114121:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114129:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114141:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6750b6fb00) 00010000:00010000:0.0:1788684193.114143:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684193.114147:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114153:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac4bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114166:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114172:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114177:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114181:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684193.114183:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114188:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114207:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d664182dd00) 00010000:00010000:0.0:1788684193.114209:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684193.114212:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114219:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac4c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114244:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac4b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a06 expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114258:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac4cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a06 expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684193.114265:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182d300) 00010000:00010000:0.0:1788684193.114267:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684193.114269:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891800, rc 0) 00000100:00100000:0.0:1788684193.114328:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:10490:x1875571073110784:12345-192.168.206.44@tcp:101:chown.0 Request processed in 618us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684193.114337:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:0.0:1788684193.117160:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684193.117240:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073110912 00000100:00100000:1.0:1788684193.117248:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073110912 00000100:00100000:1.0:1788684193.117297:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:1.0:1788684193.117306:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:10490:x1875571073110912:12345-192.168.206.44@tcp:900:chown.0 00000100:00100000:1.0:1788684193.117404:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:10490:x1875571073110912:12345-192.168.206.44@tcp:900:chown.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684193.117427:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:1.0:1788684193.127157:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.127399:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073111168 00000100:00100000:2.0:1788684193.127409:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073111168 00000100:00100000:2.0:1788684193.127461:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:2.0:1788684193.127469:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:10490:x1875571073111168:12345-192.168.206.44@tcp:36:chown.0 00010000:00010000:2.0:1788684193.127521:0:7963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684193.127549:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac4cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a06 expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.127568:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182d300) 00010000:00010000:2.0:1788684193.127573:0:7963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684193.127596:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.127610:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.127619:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788684193.130004:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1788684193.130306:0:7963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba553b7b reply state 00000000afaddf8d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.130327:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.130336:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182d300) 00010000:00010000:2.0:1788684193.130339:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788684193.130354:0:7963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788684193.130385:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788684193.130496:0:7963:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788684193.130519:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:10490:x1875571073111168:12345-192.168.206.44@tcp:36:chown.0 Request processed in 3048us (3369us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788684193.130527:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00010000:00010000:3.0:1788684193.130625:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.130635:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.130641:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.130648:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684193.130652:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.130670:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.130682:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182d300) 00010000:00010000:3.0:1788684193.130684:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788684193.130688:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.130694:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac4d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131706:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131718:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131726:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131732:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684193.131798:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131806:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131819:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d664182dd00) 00010000:00010000:1.0:1788684193.131822:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684193.131825:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131832:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac487 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131850:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131856:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131887:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131892:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684193.131895:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131901:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131909:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182d300) 00010000:00010000:1.0:1788684193.131912:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684193.131915:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131921:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac48e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131934:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131940:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131945:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131949:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684193.131952:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131967:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131975:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6750b6fb00) 00010000:00010000:1.0:1788684193.131978:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788684193.131981:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.131986:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac4a3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684193.150666:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.150774:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073111296 00000100:00100000:2.0:1788684193.150782:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073111296 00000100:00100000:2.0:1788684193.150837:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:2.0:1788684193.150847:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:10491:x1875571073111296:12345-192.168.206.44@tcp:101:touch.500 00010000:00010000:2.0:1788684193.150878:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684193.150899:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac4db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a0d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788684193.152760:0:6497:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1815us 00010000:00010000:1.0:1788684193.174135:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174158:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174168:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174184:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174192:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174198:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174308:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ac4f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174326:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ac4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174333:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ac4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684193.174386:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788684193.174391:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684193.174429:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ac4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174441:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174448:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174454:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174460:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684193.174465:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174472:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174484:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6750b6fb00) 00010000:00010000:1.0:1788684193.174487:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684193.174492:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174509:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac4e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174521:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174527:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174533:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174538:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684193.174541:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174548:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174556:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d664182d300) 00010000:00010000:1.0:1788684193.174558:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684193.174561:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174567:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac4e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174604:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac4db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a0d expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174619:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ac4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a0d expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.174634:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182dd00) 00010000:00010000:1.0:1788684193.174636:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788684193.174639:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0c00, rc 0) 00000100:00100000:1.0:1788684193.174708:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:10491:x1875571073111296:12345-192.168.206.44@tcp:101:touch.500 Request processed in 23862us (24050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684193.174717:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:3.0:1788684193.177665:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684193.177699:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073111552 00000100:00100000:3.0:1788684193.177709:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073111552 00000100:00100000:3.0:1788684193.178239:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:3.0:1788684193.178251:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:10491:x1875571073111552:12345-192.168.206.44@tcp:101:touch.500 00010000:00010000:3.0:1788684193.178269:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684193.178289:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c200/0x44bac02bd54ac4f7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a14 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.178711:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.178725:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.178813:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.178840:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.178848:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.178856:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788684193.179287:0:6498:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788684193.179635:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac50c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179645:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac50c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179653:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac50c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179680:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179687:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179692:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179697:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684193.179701:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179717:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179728:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182dd00) 00010000:00010000:3.0:1788684193.179731:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684193.179803:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179811:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac4fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788684193.179822:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8c41ef6 reply state 000000000616f59f transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179832:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179838:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff8d677cc3c200) 00010000:00010000:3.0:1788684193.179840:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788684193.179842:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788684193.179882:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c200/0x44bac02bd54ac4f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a14 expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179896:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac50c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a14 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.179903:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d677cc3c100) 00010000:00010000:3.0:1788684193.179905:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684193.179908:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d200, rc 0) 00000100:00100000:3.0:1788684193.180196:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:10491:x1875571073111552:12345-192.168.206.44@tcp:101:touch.500 Request processed in 1947us (2538us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788684193.180211:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:0.0:1788684193.184037:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.184300:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073111808 00000100:00100000:2.0:1788684193.184309:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073111808 00000100:00100000:2.0:1788684193.184355:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:2.0:1788684193.184505:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:10491:x1875571073111808:12345-192.168.206.44@tcp:36:touch.500 00010000:00010000:2.0:1788684193.184555:0:7963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684193.184578:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac50c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a14 expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.184595:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d677cc3c100) 00010000:00010000:2.0:1788684193.184603:0:7963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684193.184652:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.184664:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.184689:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684193.185003:0:7963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008321f24f reply state 0000000063d8892e transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.185016:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.185022:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d6647575f00) 00010000:00010000:2.0:1788684193.185025:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684193.185028:0:7963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684193.185251:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:10491:x1875571073111808:12345-192.168.206.44@tcp:36:touch.500 Request processed in 887us (1220us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788684193.185259:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:1.0:1788684193.187972:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684193.188035:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073111936 00000100:00100000:3.0:1788684193.188044:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073111936 00000100:00100000:1.0:1788684193.188172:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:1.0:1788684193.188184:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:10491:x1875571073111936:12345-192.168.206.44@tcp:101:touch.500 00010000:00010000:1.0:1788684193.188206:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684193.188224:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac521 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a1b expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.188273:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac521 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a1b expref: 12 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.188287:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac521 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a1b expref: 12 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.188305:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d6647575f00) 00010000:00010000:1.0:1788684193.188308:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684193.188312:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1800, rc 0) 00000100:00100000:1.0:1788684193.188470:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:10491:x1875571073111936:12345-192.168.206.44@tcp:101:touch.500 Request processed in 288us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684193.188477:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:1.0:1788684193.190652:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684193.190736:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073112064 00000100:00100000:0.0:1788684193.190799:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073112064 00000100:00100000:0.0:1788684193.190842:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:0.0:1788684193.190850:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875571073112064:12345-192.168.206.44@tcp:8:touch.500 00010000:00080000:0.0:1788684193.190891:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:0.0:1788684193.190929:0:8411:0:(genops.c:1385:class_connect()) connect: client 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e, cookie 0x44bac02bd54ac528 00002000:00100000:0.0:1788684193.190940:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e/ffff8d664789a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788684193.190957:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788684193.191027:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788684193.191056:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8d6647898800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684193.191206:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2389:x1875571073112064:12345-192.168.206.44@tcp:8:touch.500 Request processed in 355us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684193.191214:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:2.0:1788684193.193496:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684193.193629:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073112192 00000100:00100000:1.0:1788684193.193638:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073112192 00000100:00100000:1.0:1788684193.193748:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:1.0:1788684193.193758:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:0:x1875571073112192:12345-192.168.206.44@tcp:2:touch.500 00000100:00080000:3.0:1788684193.194035:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788684193.206045:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1788684193.206062:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000100:00100000:1.0:1788684193.206302:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:0:x1875571073112192:12345-192.168.206.44@tcp:2:touch.500 Request processed in 12540us (12807us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788684193.206313:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:1.0:1788684193.214401:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.214502:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073112448 00000100:00100000:2.0:1788684193.214511:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073112448 00000100:00100000:2.0:1788684193.214566:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:2.0:1788684193.214577:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:10491:x1875571073112448:12345-192.168.206.44@tcp:35:touch.500 00000100:00100000:2.0:1788684193.215047:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:10491:x1875571073112448:12345-192.168.206.44@tcp:35:touch.500 Request processed in 470us (689us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788684193.215056:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:2.0:1788684193.244359:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684193.244638:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073112576 00000100:00100000:3.0:1788684193.244647:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073112576 00000100:00100000:3.0:1788684193.244703:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:3.0:1788684193.244712:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:10492:x1875571073112576:12345-192.168.206.44@tcp:101:rm.0 00010000:00010000:3.0:1788684193.244734:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684193.244753:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c200/0x44bac02bd54ac52f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a22 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.244812:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac536 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.244825:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.244837:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684193.244888:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788684193.244892:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684193.244928:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.244956:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c200/0x44bac02bd54ac52f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a22 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.244972:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac536 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a22 expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.244992:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182dd00) 00010000:00010000:3.0:1788684193.244995:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788684193.244999:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d000, rc 0) 00000100:00100000:3.0:1788684193.245060:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:10492:x1875571073112576:12345-192.168.206.44@tcp:101:rm.0 Request processed in 348us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684193.245067:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:0.0:1788684193.251695:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.251767:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073112832 00000100:00100000:2.0:1788684193.251776:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073112832 00000100:00100000:2.0:1788684193.251832:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:2.0:1788684193.251842:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:10492:x1875571073112832:12345-192.168.206.44@tcp:101:rm.0 00010000:00010000:2.0:1788684193.251884:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684193.251904:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac53d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a29 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684193.251999:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788684193.252123:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac53d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a29 expref: 16 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.252139:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6750b6fb00) 00010000:00010000:2.0:1788684193.252143:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788684193.252148:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac53d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a29 expref: 16 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.252160:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684193.252265:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:10492:x1875571073112832:12345-192.168.206.44@tcp:101:rm.0 Request processed in 425us (580us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788684193.252272:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:1.0:1788684193.258486:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684193.258821:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073112960 00000100:00100000:3.0:1788684193.258831:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073112960 00000100:00100000:3.0:1788684193.258892:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:3.0:1788684193.258904:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:10492:x1875571073112960:12345-192.168.206.44@tcp:37:rm.0 00000100:00100000:0.0:1788684193.264625:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:10492:x1875571073112960:12345-192.168.206.44@tcp:37:rm.0 Request processed in 5715us (6139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684193.264706:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:0.0:1788684193.269208:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.269300:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073113216 00000100:00100000:2.0:1788684193.269309:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073113216 00000100:00100000:2.0:1788684193.269363:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:2.0:1788684193.269401:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749554c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:10492:x1875571073113216:12345-192.168.206.44@tcp:35:rm.0 00000100:00100000:2.0:1788684193.269578:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749554c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:10492:x1875571073113216:12345-192.168.206.44@tcp:35:rm.0 Request processed in 178us (377us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788684193.269585:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:1.0:1788684193.272915:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.273010:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073113472 00000100:00100000:2.0:1788684193.273020:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073113472 00000100:00100000:2.0:1788684193.273079:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:2.0:1788684193.273110:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:10492:x1875571073113472:12345-192.168.206.44@tcp:101:rm.0 00010000:00010000:2.0:1788684193.273132:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684193.273150:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac54b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a30 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.273476:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac552 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.273492:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac552 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.273503:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac552 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684193.273513:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788684193.273712:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac54b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a30 expref: 19 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.273730:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac552 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a30 expref: 18 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.273799:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182dd00) 00010000:00010000:2.0:1788684193.273802:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788684193.273805:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5200, rc 0) 00000100:00100000:2.0:1788684193.273910:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:10492:x1875571073113472:12345-192.168.206.44@tcp:101:rm.0 Request processed in 801us (1003us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788684193.273918:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:1.0:1788684193.277851:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684193.277935:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073113600 00000100:00100000:0.0:1788684193.277945:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073113600 00000100:00100000:0.0:1788684193.278025:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:0.0:1788684193.278034:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:10492:x1875571073113600:12345-192.168.206.44@tcp:41:rm.0 00000004:00000024:0.0:1788684193.278080:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788684193.278151:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:10492:x1875571073113600:12345-192.168.206.44@tcp:41:rm.0 Request processed in 117us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684193.278158:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:0.0:1788684193.281223:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684193.281307:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073113728 00000100:00100000:3.0:1788684193.281316:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073113728 00000100:00100000:3.0:1788684193.281468:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:3.0:1788684193.281478:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:10492:x1875571073113728:12345-192.168.206.44@tcp:101:rm.0 00010000:00010000:3.0:1788684193.281498:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684193.281519:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c200/0x44bac02bd54ac560 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a37 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281578:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281591:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281602:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281628:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281649:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281657:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281743:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac575 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281752:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281758:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684193.281790:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788684193.281794:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684193.281809:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281819:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281827:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281833:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281850:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281855:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711ce00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684193.281859:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281878:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281891:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182dd00) 00010000:00010000:3.0:1788684193.281894:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684193.281898:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281904:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ce00/0x44bac02bd54ac567 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281917:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281923:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281929:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281934:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684193.281938:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281953:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281961:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff8d677cc3c200) 00010000:00010000:3.0:1788684193.281963:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684193.281966:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281972:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d800/0x44bac02bd54ac56e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.281998:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c200/0x44bac02bd54ac560 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a37 expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.282010:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a37 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684193.282017:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d6647575f00) 00010000:00010000:3.0:1788684193.282019:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684193.282021:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c800, rc 0) 00000100:00100000:3.0:1788684193.282069:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:10492:x1875571073113728:12345-192.168.206.44@tcp:101:rm.0 Request processed in 592us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684193.282077:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:1.0:1788684193.292266:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.292418:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073113984 00000100:00100000:2.0:1788684193.292428:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073113984 00000100:00100000:2.0:1788684193.292589:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:2.0:1788684193.292599:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:10492:x1875571073113984:12345-192.168.206.44@tcp:36:rm.0 00010000:00010000:2.0:1788684193.292653:0:12443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788684193.292679:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac575 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a37 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.292700:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1800/0x44bac02bd54ac521 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a1b expref: 18 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.292710:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d6647575f00) 00010000:00010000:2.0:1788684193.292719:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac536 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a22 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.292727:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182dd00) 00010000:00010000:2.0:1788684193.292730:0:12443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684193.292906:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.292920:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.292930:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.292941:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.292948:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.292965:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293053:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293061:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293067:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788684193.293442:0:12443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788684193.293453:0:12443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 274287086216ns, next at 275287083678ns, rc = 0 00010000:00010000:2.0:1788684193.293629:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293638:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293644:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293651:0:12443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293657:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293662:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293822:0:12443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684193.293841:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293848:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293854:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293860:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684193.293863:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293885:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293895:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d6647575f00) 00010000:00010000:2.0:1788684193.293898:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788684193.293901:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293906:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac58a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293921:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293927:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293943:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293947:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684193.293950:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293956:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293964:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182dd00) 00010000:00010000:2.0:1788684193.293966:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684193.293969:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293974:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ac57c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684193.293983:0:12443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9f54dc6 reply state 00000000fc0e1b1c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293993:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.293998:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff8d677cc3c200) 00010000:00010000:2.0:1788684193.294000:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684193.294002:0:12443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684193.294078:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:10492:x1875571073113984:12345-192.168.206.44@tcp:36:rm.0 Request processed in 1479us (1820us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788684193.294095:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:3.0:1788684193.298217:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.298279:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073114240 00000100:00100000:2.0:1788684193.298287:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073114240 00000100:00100000:2.0:1788684193.298351:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:2.0:1788684193.298361:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:10492:x1875571073114240:12345-192.168.206.44@tcp:35:rm.0 00000100:00100000:2.0:1788684193.298587:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:10492:x1875571073114240:12345-192.168.206.44@tcp:35:rm.0 Request processed in 227us (376us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788684193.298594:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00010000:00010000:1.0:1788684193.299020:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684193.299029:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.299039:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684193.299044:0:6485:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.299053:0:6485:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.299070:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d6647575f00) 00010000:00010000:1.0:1788684193.299074:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788684193.299078:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.299085:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac591 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684193.299111:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684193.299113:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684193.299114:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684193.301256:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684193.301492:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073114496 00000100:00100000:2.0:1788684193.301502:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073114496 00000100:00100000:2.0:1788684193.301545:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:2.0:1788684193.301554:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:10492:x1875571073114496:12345-192.168.206.44@tcp:36:rm.0 00010000:00010000:2.0:1788684193.301600:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788684193.301623:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac552 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a30 expref: 19 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.301643:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ac4f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a0d expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.301655:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d664182dd00) 00010000:00010000:2.0:1788684193.301675:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac4b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ff expref: 17 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.301693:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6750b6fb00) 00010000:00010000:2.0:1788684193.301699:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684193.301721:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.301732:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.301993:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.302059:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.302067:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.302074:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.302153:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.302161:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.302180:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684193.304860:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788684193.304972:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.304983:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.304991:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.304997:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684193.305109:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305117:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305132:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8d6647575c00) 00010000:00010000:2.0:1788684193.305135:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788684193.305139:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305146:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac5a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305170:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305176:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305181:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305186:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684193.305189:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305195:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305202:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647575300) 00010000:00010000:2.0:1788684193.305205:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684193.305214:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305220:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac598 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684193.305234:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1c9844e reply state 0000000045159e4d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305245:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684193.305252:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d6647575400) 00010000:00010000:2.0:1788684193.305254:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684193.305257:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684193.305575:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:10492:x1875571073114496:12345-192.168.206.44@tcp:36:rm.0 Request processed in 4017us (4321us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788684193.305584:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:0.0:1788684193.405698:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684193.405745:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085774336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684193.405813:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684193.405995:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085774336 00000100:00100000:2.0:1788684193.406002:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085774336 00000100:00100000:2.0:1788684193.406051:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788684193.406060:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085774336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684193.406095:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684193.406144:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085774336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684193.406151:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1788684193.406194:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa68000 x1875571085774336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684193.406213:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085774336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684193.406606:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085774464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684193.406642:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684193.406889:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085774592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684193.406921:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684193.406954:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085774592 00000100:00100000:1.0:1788684193.406958:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085774592 00000100:00100000:1.0:1788684193.406987:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788684193.406994:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085774592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684193.407008:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684193.407041:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085774592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684193.407048:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1788684193.407078:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6775ef7b80 x1875571085774592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684193.407215:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085774592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684193.407286:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085774464 00000100:00100000:2.0:1788684193.407291:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085774464 00000100:00100000:2.0:1788684193.407325:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788684193.407331:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085774464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684193.407353:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788684193.407407:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085774464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684193.407414:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00010000:2.0:1788684193.407458:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684193.407604:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085774464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684193.917574:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684193.917601:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085774720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684193.917694:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684193.917791:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085774720 00000100:00100000:2.0:1788684193.917800:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085774720 00000100:00100000:0.0:1788684193.918110:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788684193.918123:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085774720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684193.918157:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788684193.918216:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085774720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684193.918223:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788684193.918527:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085774720:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788684194.430042:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684195.454016:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684196.477608:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684196.538595:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684196.539245:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684196.539281:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684196.539333:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684196.539425:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684196.539452:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684196.539477:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073115008 00000100:00100000:3.0:1788684196.539485:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073115008 00000100:00100000:3.0:1788684196.539566:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:3.0:1788684196.539576:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073115008:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684196.539637:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073115008:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684196.539647:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00080000:3.0:1788684196.539679:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684196.539721:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073114880 00000100:00100000:3.0:1788684196.539725:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073114880 00000100:00100000:3.0:1788684196.539753:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073115136 00000100:00100000:3.0:1788684196.539756:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073115136 00000100:00100000:3.0:1788684196.539767:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073114752 00000100:00100000:3.0:1788684196.539769:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073114752 00000100:00100000:3.0:1788684196.539778:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073115264 00000100:00100000:3.0:1788684196.539779:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073115264 00000100:00100000:3.0:1788684196.539793:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:3.0:1788684196.539799:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073114880:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684196.539833:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073114880:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 35us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684196.539841:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:3.0:1788684196.539868:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:2.0:1788684196.539875:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073114624 00000100:00100000:3.0:1788684196.539876:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073115136:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684196.539883:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073114624 00000100:00100000:3.0:1788684196.539912:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073115136:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684196.539924:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 333 00000100:00100000:3.0:1788684196.539930:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:2.0:1788684196.539936:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073114624:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684196.539961:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:3.0:1788684196.539972:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2391:x1875571073114752:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684196.539972:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073114624:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684196.539988:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 333 00000100:00100000:3.0:1788684196.540024:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2391:x1875571073114752:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 54us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684196.540028:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:3.0:1788684196.540037:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:2.0:1788684196.540042:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073115264:12345-192.168.206.44@tcp:400:kworker.0 00000100:00080000:3.0:1788684196.540063:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684196.540067:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684196.540085:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073115264:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 47us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684196.540100:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 194 00010000:00010000:0.0:1788684197.501573:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788684197.607548:0:13658:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1788684198.014619:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085775232:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.014735:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.014782:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085775744:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.014807:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.014823:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085776256:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.014854:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.014879:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788684198.014885:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085774848:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.014912:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.014932:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085775360:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.014986:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.015005:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085775872:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015026:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.015041:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085776384:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015060:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.015096:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085775104:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015121:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.015136:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085775616:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015154:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.015168:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085776128:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015185:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.015200:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788684198.015206:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085774976:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015225:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.015239:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085775488:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015257:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.015272:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085776000:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015288:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.015306:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085775232 00000100:00100000:3.0:1788684198.015312:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085775232 00000100:00100000:3.0:1788684198.015344:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085775616 00000100:00100000:3.0:1788684198.015346:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085775616 00000100:00100000:3.0:1788684198.015385:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085776128 00000100:00100000:3.0:1788684198.015389:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085776128 00000100:00100000:3.0:1788684198.015400:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085774976 00000100:00100000:3.0:1788684198.015403:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085774976 00000100:00100000:3.0:1788684198.015412:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085775488 00000100:00100000:3.0:1788684198.015415:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085775488 00000100:00100000:3.0:1788684198.015425:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085776000 00000100:00100000:3.0:1788684198.015429:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085776000 00000100:00100000:3.0:1788684198.015441:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788684198.015448:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085775232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015495:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085775232:12345-0@lo:400:kworker.0 Request processed in 47us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.015508:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788684198.015524:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788684198.015529:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085775616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015560:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085775616:12345-0@lo:400:kworker.0 Request processed in 32us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.015566:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788684198.015576:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788684198.015581:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085776128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015606:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085776128:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.015611:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788684198.015621:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788684198.015627:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085774976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015654:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085774976:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.015660:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788684198.015671:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788684198.015676:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085775488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015700:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085775488:12345-0@lo:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.015706:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788684198.015717:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788684198.015723:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085776000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015749:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085776000:12345-0@lo:400:kworker.0 Request processed in 25us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.015761:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788684198.015781:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085775744 00000100:00100000:3.0:1788684198.015784:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085775744 00000100:00100000:3.0:1788684198.015822:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085776256 00000100:00100000:3.0:1788684198.015825:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085776256 00000100:00100000:3.0:1788684198.015836:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085775872 00000100:00100000:3.0:1788684198.015838:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085775872 00000100:00100000:3.0:1788684198.015860:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085776384 00000100:00100000:3.0:1788684198.015862:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085776384 00000100:00100000:3.0:1788684198.015873:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788684198.015879:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085775744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015909:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085775744:12345-0@lo:400:kworker.0 Request processed in 30us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.015915:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788684198.015925:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788684198.015931:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085776256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.015956:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085776256:12345-0@lo:400:kworker.0 Request processed in 26us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.015962:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788684198.015973:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788684198.015978:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085775872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016006:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085775872:12345-0@lo:400:kworker.0 Request processed in 28us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.016012:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788684198.016022:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788684198.016027:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085776384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016063:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085776384:12345-0@lo:400:kworker.0 Request processed in 37us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.016069:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788684198.016088:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085775360 00000100:00100000:3.0:1788684198.016091:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085775360 00000100:00100000:3.0:1788684198.016112:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085775104 00000100:00100000:3.0:1788684198.016115:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085775104 00000100:00100000:3.0:1788684198.016126:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788684198.016131:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085775360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016159:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085775360:12345-0@lo:400:kworker.0 Request processed in 28us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.016166:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788684198.016175:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788684198.016180:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085775104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016205:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085775104:12345-0@lo:400:kworker.0 Request processed in 25us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.016211:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1788684198.016232:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684198.016235:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684198.016238:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684198.016239:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684198.016266:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085774976:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016278:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085775488:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016285:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085776000:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016293:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085775104:0@lo:400:kworker.0 00010000:00080000:3.0:1788684198.016315:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a7100 x1875571085775616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684198.016326:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085775616:0@lo:400:kworker.0 00010000:00080000:3.0:1788684198.016336:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a7480 x1875571085776128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684198.016345:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085776128:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016404:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085775360:0@lo:400:kworker.0 00010000:00080000:3.0:1788684198.016414:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5880 x1875571085775872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684198.016422:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085775872:0@lo:400:kworker.0 00010000:00080000:3.0:1788684198.016432:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a7800 x1875571085776384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684198.016440:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085776384:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016451:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085775232:0@lo:400:kworker.0 00010000:00080000:3.0:1788684198.016461:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5c00 x1875571085775744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684198.016469:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085775744:0@lo:400:kworker.0 00010000:00080000:3.0:1788684198.016479:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5500 x1875571085776256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684198.016486:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085776256:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016564:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684198.016580:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085776512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684198.016633:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.016664:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085776512 00000100:00100000:3.0:1788684198.016668:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085776512 00000100:00100000:3.0:1788684198.016697:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788684198.016703:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085776512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684198.016723:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684198.016757:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085776512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.016764:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1788684198.016791:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66478f4380 x1875571085776512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684198.016805:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085776512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684198.016830:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085774848 00000100:00100000:3.0:1788684198.016834:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085774848 00000100:00100000:3.0:1788684198.016871:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788684198.016878:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085774848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.016913:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085774848:12345-0@lo:400:kworker.0 Request processed in 36us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.016920:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788684198.016949:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085774848:0@lo:400:kworker.0 00000100:00100000:3.0:1788684198.025055:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788684198.025074:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085776640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684198.025136:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684198.025176:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085776640 00000100:00100000:3.0:1788684198.025183:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085776640 00000100:00100000:3.0:1788684198.025236:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788684198.025244:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085776640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684198.025266:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684198.025307:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085776640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684198.025314:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788684198.025349:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66478f4380 x1875571085776640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684198.025398:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085776640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684198.525792:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085776768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684198.525896:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684198.525990:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085776768 00000100:00100000:2.0:1788684198.525999:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085776768 00000100:00100000:2.0:1788684198.526054:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788684198.526063:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085776768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684198.526107:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788684198.527902:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085776768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1831us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684198.527915:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788684198.527923:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085776896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684198.527995:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684198.528111:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085776896 00000100:00100000:0.0:1788684198.528119:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085776768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684198.528124:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085776896 00000100:00100000:2.0:1788684198.528181:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788684198.528190:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085776896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684198.528219:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684198.528272:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085776896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684198.528279:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000004:00080000:2.0:1788684198.528701:0:9987:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 279522333724ns, next at 280522330207ns, rc = 0 00000100:00100000:2.0:1788684198.528736:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085777024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684198.528775:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788684198.530218:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa6aa00 x1875571085776896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684198.530246:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085776896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684198.530388:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085777024 00000100:00100000:2.0:1788684198.530397:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085777024 00000100:00100000:2.0:1788684198.530435:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788684198.530450:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085777024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684198.530473:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684198.530528:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085777024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684198.530535:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1788684198.530577:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647909f80 x1875571085777024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684198.530595:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085777024:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788684198.532027:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788684198.532074:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788684198.532146:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788684198.532209:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532220:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532226:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532231:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684198.532235:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532242:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532258:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff8d677cc3c200) 00010000:00010000:2.0:1788684198.532261:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684198.532264:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532282:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac505 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532313:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532319:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532324:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532329:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684198.532332:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532338:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532348:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8d6647575f00) 00010000:00010000:2.0:1788684198.532350:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684198.532353:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532359:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac51a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532415:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532421:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532434:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532441:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684198.532445:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532453:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532463:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff8d677cc3c200) 00010000:00010000:2.0:1788684198.532466:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684198.532469:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532475:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac583 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532507:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532515:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532521:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532526:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684198.532530:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532550:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532563:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d6647575400) 00010000:00010000:2.0:1788684198.532567:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684198.532570:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.532577:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac59f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684198.532582:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085777152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788684198.532667:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684198.532834:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085777152 00000100:00100000:2.0:1788684198.532977:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085777152 00000100:00100000:2.0:1788684198.533028:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684198.533037:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085777152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788684198.533062:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788684198.533173:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9d27a1, atime: 0x6a9d27a1, ctime: 0x6a9d27a1, blocks: 0x0 00010000:00010000:2.0:1788684198.533181:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533195:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=279s v=(0 0) 00010000:00010000:2.0:1788684198.533199:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684198.533206:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533222:0:8412:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533245:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533253:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533270:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788684198.533488:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1875571085777152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 452us (821us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788684198.533496:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788684198.533526:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684198.533533:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533542:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684198.533547:0:6486:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533555:0:6486:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533571:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533578:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ac5ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.533605:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684198.533607:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684198.533609:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684198.535351:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788684198.535555:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d677fa6aa00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788684198.535584:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085777152:0@lo:6:osp-syn-1-0.0 00000020:00000080:1.0:1788684198.683579:0:13706:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbbf194e0 20000000:00000080:1.0:1788684198.683608:0:13706:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d677fad8c00 uarg=0000000000000000 20000000:01000000:1.0:1788684198.683673:0:13706:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788684198.683680:0:13706:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788684198.683686:0:13706:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788684198.687235:0:13707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788684198.687616:0:13706:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788684198.693191:0:13706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788684198.693234:0:13706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788684198.693268:0:13706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788684198.693286:0:13706:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788684198.693305:0:13706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693324:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac43a expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693331:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac448 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693338:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac456 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693344:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac464 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693353:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ea expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693360:0:13706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f1 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693482:0:13706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693522:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f1 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693535:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f1 expref: 12 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.693564:0:13706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777280:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684198.693674:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ea expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693685:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ea expref: 12 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.693694:0:13706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777408:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684198.693791:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac464 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693800:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac464 expref: 23 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.693808:0:13706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777536:0@lo:104: 00000100:00100000:1.0:1788684198.693856:0:13706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684198.693893:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac456 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693901:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac456 expref: 23 pid: 6490 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.693909:0:13706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777664:0@lo:104: 00010000:00010000:1.0:1788684198.693932:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac448 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693940:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac448 expref: 23 pid: 6489 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.693954:0:13706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777792:0@lo:104: 00010000:00010000:1.0:1788684198.693982:0:13706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ac43a expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.693990:0:13706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ac43a expref: 23 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.693999:0:13706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777920:0@lo:104: 00000100:00100000:1.0:1788684198.694030:0:13706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684198.694420:0:10374:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788684198.694447:0:10374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684198.694470:0:10374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684198.694486:0:10374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684198.694507:0:10374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085777536 00000100:00100000:0.0:1788684198.694513:0:10374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085777536 00000100:00100000:0.0:1788684198.694544:0:10374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085777664 00000100:00100000:0.0:1788684198.694547:0:10374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085777664 00000100:00100000:0.0:1788684198.694556:0:10374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085777792 00000100:00100000:0.0:1788684198.694558:0:10374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085777792 00000100:00100000:0.0:1788684198.694566:0:10374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085777920 00000100:00100000:0.0:1788684198.694568:0:10374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085777920 00000100:00100000:0.0:1788684198.694578:0:10374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684198.694585:0:10374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677e4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:13706:x1875571085777536:12345-0@lo:104: 00010000:00010000:0.0:1788684198.694597:0:10374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.694645:0:10374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684198.694651:0:10374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677e4ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+6:13706:x1875571085777536:12345-0@lo:104: Request processed in 66us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684198.694658:0:10374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684198.694699:0:10374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684198.694716:0:10374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:13706:x1875571085777664:12345-0@lo:104: 00010000:00010000:0.0:1788684198.694724:0:10374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.694753:0:10374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788684198.694758:0:10374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+5:13706:x1875571085777664:12345-0@lo:104: Request processed in 54us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684198.694763:0:10374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684198.694776:0:10374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788684198.694788:0:10374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:13706:x1875571085777792:12345-0@lo:104: 00010000:00010000:0.0:1788684198.694796:0:10374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.694827:0:10374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788684198.694832:0:10374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+4:13706:x1875571085777792:12345-0@lo:104: Request processed in 46us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684198.694848:0:10374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788684198.694862:0:10374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788684198.694868:0:10374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:13706:x1875571085777920:12345-0@lo:104: 00010000:00010000:0.0:1788684198.694874:0:10374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.694899:0:10374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788684198.694903:0:10374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+3:13706:x1875571085777920:12345-0@lo:104: Request processed in 37us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684198.694909:0:10374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788684198.694925:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788684198.694930:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.694937:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684198.694942:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.694950:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684198.694958:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684198.694970:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684198.694997:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695003:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684198.695019:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695026:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ac464 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac46b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695039:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788684198.695042:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695047:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477ff000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684198.695050:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695056:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684198.695062:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684198.695067:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684198.695078:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695083:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684198.695094:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695100:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477ff000/0x44bac02bd54ac456 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac45d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695108:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684198.695111:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695117:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477ff200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684198.695119:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695126:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684198.695132:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684198.695137:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684198.695149:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695155:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684198.695167:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695173:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477ff200/0x44bac02bd54ac448 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac44f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695181:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684198.695189:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695194:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684198.695197:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695204:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684198.695210:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684198.695215:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684198.695227:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695233:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684198.695239:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695245:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54ac43a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ac441 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695258:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684198.695260:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684198.695262:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684198.695268:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684198.695285:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085778048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684198.695310:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684198.695333:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684198.695345:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085778176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684198.695385:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684198.695412:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085778304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684198.695432:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684198.695450:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684198.695455:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085778432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684198.695472:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684198.695497:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085778048 00000100:00100000:0.0:1788684198.695501:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085778048 00010000:00010000:0.0:1788684198.695518:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac464 expref: 24 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684198.695533:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085778176 00000100:00100000:0.0:1788684198.695536:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085778176 00010000:00010000:0.0:1788684198.695546:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac456 expref: 25 pid: 6490 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684198.695555:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085778304 00000100:00100000:0.0:1788684198.695558:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085778304 00010000:00010000:0.0:1788684198.695567:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac448 expref: 26 pid: 6489 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684198.695575:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085778432 00000100:00100000:0.0:1788684198.695577:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085778432 00010000:00010000:0.0:1788684198.695585:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac43a expref: 27 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684198.695595:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788684198.695600:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+27:3623:x1875571085778048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684198.695609:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684198.695620:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac464 expref: 27 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695629:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac464 expref: 27 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695643:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684198.695670:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+27:3623:x1875571085778048:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684198.695676:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788684198.695687:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788684198.695692:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+26:3623:x1875571085778176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684198.695699:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684198.695703:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac456 expref: 26 pid: 6490 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695711:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac456 expref: 26 pid: 6490 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695719:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684198.695739:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+26:3623:x1875571085778176:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684198.695744:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788684198.695756:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788684198.695761:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+25:3625:x1875571085778304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684198.695767:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684198.695771:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac448 expref: 25 pid: 6489 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695789:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac448 expref: 25 pid: 6489 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695798:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684198.695823:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+25:3625:x1875571085778304:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684198.695829:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788684198.695855:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684198.695862:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085778432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684198.695869:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684198.695873:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ac43a expref: 24 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695881:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ac43a expref: 24 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684198.695890:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684198.695910:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085778432:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684198.695916:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684198.695950:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085778432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684198.695958:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085778304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684198.695985:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085778176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684198.695992:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085778048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684198.696266:0:13706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d676d811800/0x44bac02bd54ac46b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac464 expref: 23 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.696280:0:13706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777536:0@lo:104: 00010000:00010000:1.0:1788684198.696290:0:13706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d676d811200/0x44bac02bd54ac45d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac456 expref: 22 pid: 6490 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.696299:0:13706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777664:0@lo:104: 00010000:00010000:1.0:1788684198.696308:0:13706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477ffe00/0x44bac02bd54ac44f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac448 expref: 21 pid: 6489 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.696315:0:13706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777792:0@lo:104: 00010000:00010000:1.0:1788684198.696324:0:13706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477ff600/0x44bac02bd54ac441 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ac43a expref: 20 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684198.696332:0:13706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777920:0@lo:104: 00010000:00010000:2.0:1788684198.696414:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684198.697049:0:13706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777280:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684198.697058:0:13706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13706:1875571085777408:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684198.697103:0:13706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684198.701341:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684198.701963:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684198.702277:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073115520 00000100:00100000:1.0:1788684198.702286:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073115520 00010000:00010000:1.0:1788684198.702321:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ea expref: 13 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684198.702361:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073115392 00000100:00100000:2.0:1788684198.702419:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073115392 00010000:00010000:2.0:1788684198.702437:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f1 expref: 14 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684198.702552:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:2.0:1788684198.702562:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+14:2392:x1875571073115520:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684198.702575:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684198.702581:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ea expref: 14 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702592:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ea expref: 14 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702608:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d676d810000/0x44bac02bd54ac472 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39ea expref: 14 pid: 6490 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702622:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684198.702766:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073115520:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 205us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684198.702774:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:2.0:1788684198.702791:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:2.0:1788684198.702806:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+12:2392:x1875571073115392:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684198.702814:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684198.702818:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f1 expref: 12 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702826:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f1 expref: 12 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702835:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711c600/0x44bac02bd54ac479 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39f1 expref: 12 pid: 6491 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702857:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702865:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702878:0:9510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702885:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702892:0:9510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702898:0:9510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702903:0:9510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684198.702907:0:9510:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702920:0:9510:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702935:0:9510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684198.702944:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684198.702963:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+11:2392:x1875571073115392:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 157us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684198.702970:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00010000:00010000:1.0:1788684198.703308:0:13706:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.703317:0:13706:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684198.703323:0:13706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a0200/0x44bac02bd54ac5b4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684199.039210:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085778560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684199.039279:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684199.039502:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085778560 00000100:00100000:2.0:1788684199.039511:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085778560 00000100:00100000:2.0:1788684199.039561:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788684199.039569:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085778560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684199.039600:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788684199.039653:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085778560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684199.039660:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788684199.039773:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085778560:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788684199.551487:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788684199.565238:0:13755:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0fac50a0 20000000:00000080:0.0:1788684199.565256:0:13755:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d664777f800 uarg=0000000000000000 20000000:01000000:0.0:1788684199.565298:0:13755:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788684199.565304:0:13755:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788684199.565309:0:13755:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788684199.582524:0:13756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788684199.585516:0:13755:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788684199.585691:0:13755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788684199.585726:0:13755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788684199.585742:0:13755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788684199.585754:0:13755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788684199.585774:0:13755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585790:0:13755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585800:0:13755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585806:0:13755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585827:0:13755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585846:0:13755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585852:0:13755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684199.585857:0:13755:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585865:0:13755:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585879:0:13755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585888:0:13755:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.585894:0:13755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ac5bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684199.805470:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684199.805478:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67771bc800 from 7 10000000:01000000:0.0:1788684199.805482:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684199.805546:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.805558:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.805568:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684199.805592:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085778688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.805657:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.805724:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684199.805983:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085778688 00000100:00100000:3.0:1788684199.805990:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085778688 00000100:00100000:3.0:1788684199.806040:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788684199.806049:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:6495:x1875571085778688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684199.806061:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684199.806074:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711d800/0x44bac02bd54ac5c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac5c2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684199.806094:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711d800/0x44bac02bd54ac5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac5c2 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684199.806105:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711d800/0x44bac02bd54ac5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac5c2 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684199.806113:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d800, rc 0) 00000100:00100000:3.0:1788684199.806158:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085778688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684199.806180:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788684199.806476:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085778688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684199.806501:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.806531:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684199.806589:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085778816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.806619:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.806638:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684199.806654:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085778816 00000100:00100000:2.0:1788684199.806660:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085778816 00000100:00100000:2.0:1788684199.806689:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788684199.806696:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085778816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684199.806806:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085778816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684199.806812:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788684199.811401:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085778816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.811470:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085778944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.812783:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.812829:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684199.814599:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085778944 00000100:00100000:2.0:1788684199.814624:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085778944 00000100:00100000:2.0:1788684199.814682:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788684199.814692:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085778944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684199.814842:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085778944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684199.814856:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788684199.814889:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085778944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684199.821983:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13768:1875571085779072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684199.822064:0:13768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684199.822109:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647bd9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788684199.822281:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085779072 00000100:00100000:3.0:1788684199.822288:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085779072 00000100:00100000:3.0:1788684199.822385:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788684199.822395:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:13768:x1875571085779072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684199.822506:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:13768:x1875571085779072:12345-0@lo:502:llog_process_th.0 Request processed in 112us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684199.822513:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788684199.822601:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13768:1875571085779072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684199.822624:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684199.822632:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684199.822634:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788684199.822640:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d67771bc800 00000020:00000080:2.0:1788684199.822643:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788684199.822695:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684199.822698:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684199.822700:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788684199.822702:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684199.822704:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684199.822706:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788684199.822709:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d67771bc800 00000020:00000080:2.0:1788684199.822711:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788684199.822739:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13768:1875571085779200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684199.822769:0:13768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.834343:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085779200 00000100:00100000:0.0:1788684199.834356:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085779200 00000100:00100000:0.0:1788684199.834413:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788684199.834422:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:13768:x1875571085779200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684199.834565:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:13768:x1875571085779200:12345-0@lo:502:llog_process_th.0 Request processed in 144us (11794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684199.834643:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788684199.836979:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647bd9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788684199.837012:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13768:1875571085779200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788684199.837048:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684199.837057:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684199.837059:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788684199.837063:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788684199.837220:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788684199.837242:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684199.837319:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.837331:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684199.837350:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684199.837352:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677e122800 from 7 10000000:01000000:0.0:1788684199.837355:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684199.837415:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.837424:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.837432:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684199.837450:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085779328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.837500:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.837523:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684199.838385:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085779328 00000100:00100000:3.0:1788684199.838393:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085779328 00000100:00100000:3.0:1788684199.838434:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788684199.838442:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:6495:x1875571085779328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684199.838454:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684199.838466:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711c200/0x44bac02bd54ac5d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac5d0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684199.838487:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711c200/0x44bac02bd54ac5d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac5d0 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684199.838497:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711c200/0x44bac02bd54ac5d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac5d0 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684199.838516:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c200, rc 0) 00000100:00100000:3.0:1788684199.838564:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085779328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684199.838721:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788684199.838766:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085779328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684199.838781:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684199.838790:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684199.839330:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085779456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684199.839439:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684199.839516:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c7540 going to sleep for 11 seconds 00000040:00080000:1.0:1788684199.847383:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788684199.853670:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085779456 00000100:00100000:0.0:1788684199.853683:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085779456 00000100:00100000:0.0:1788684199.853733:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788684199.853742:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085779456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.853902:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085779456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (14536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684199.853909:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788684199.854057:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085779456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684199.854101:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085779584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684199.854140:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684199.854177:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684199.854563:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085779584 00000100:00100000:1.0:1788684199.854568:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085779584 00000100:00100000:1.0:1788684199.854603:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788684199.854609:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085779584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684199.854691:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085779584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684199.854706:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788684199.854845:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085779584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.856822:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13773:1875571085779712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684199.856903:0:13773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.856941:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750a08b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684199.857033:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085779712 00000100:00100000:1.0:1788684199.857039:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085779712 00000100:00100000:1.0:1788684199.857079:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788684199.857087:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:13773:x1875571085779712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684199.857187:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:13773:x1875571085779712:12345-0@lo:502:llog_process_th.0 Request processed in 100us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684199.857194:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788684199.857683:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13773:1875571085779712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684199.857716:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684199.857724:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684199.857727:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684199.857733:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d677e122800 00000020:00000080:0.0:1788684199.857735:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684199.857788:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684199.857791:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684199.857793:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684199.857795:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684199.857798:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684199.857799:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788684199.857802:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d677e122800 00000020:00000080:0.0:1788684199.857804:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788684199.857845:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13773:1875571085779840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684199.860424:0:13773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.860469:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750a08b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684199.860549:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085779840 00000100:00100000:1.0:1788684199.860556:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085779840 00000100:00100000:1.0:1788684199.860608:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788684199.860617:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:13773:x1875571085779840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684199.860725:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:13773:x1875571085779840:12345-0@lo:502:llog_process_th.0 Request processed in 108us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684199.860732:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788684199.860881:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13773:1875571085779840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684199.860909:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684199.860916:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684199.860918:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788684199.860923:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788684199.861133:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788684199.861152:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788684199.861161:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.861170:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684199.861180:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788684199.861183:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677cc6f800 from 7 10000000:01000000:1.0:1788684199.861185:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788684199.861212:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.861225:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.861235:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684199.861942:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085779968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788684199.861986:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684199.862003:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647707600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684199.862129:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085779968 00000100:00100000:0.0:1788684199.862134:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085779968 00000100:00100000:0.0:1788684199.862170:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788684199.862177:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:6495:x1875571085779968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684199.862187:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684199.862199:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647890600/0x44bac02bd54ac5e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac5de expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.862230:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647890600/0x44bac02bd54ac5e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac5de expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.862240:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647890600/0x44bac02bd54ac5e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac5de expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.862248:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890600, rc 0) 00000100:00100000:0.0:1788684199.862396:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085779968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684199.862403:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788684199.862699:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085779968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684199.862712:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.862721:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684199.862782:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684199.862806:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684199.864458:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647707600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684199.864942:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085780096 00000100:00100000:0.0:1788684199.865110:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085780096 00000100:00100000:0.0:1788684199.865159:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788684199.865167:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085780096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.865313:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085780096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684199.865322:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788684199.865354:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684199.865422:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684199.865475:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684199.865511:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647bd9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684199.865518:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085780224 00000100:00100000:1.0:1788684199.865524:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085780224 00000100:00100000:0.0:1788684199.865609:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788684199.865618:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085780224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.865701:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085780224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684199.865707:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788684199.865749:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684199.866453:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13774:1875571085780352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684199.866492:0:13774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684199.866510:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647707cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684199.866561:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085780352 00000100:00100000:0.0:1788684199.866566:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085780352 00000100:00100000:0.0:1788684199.866604:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788684199.866612:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:13774:x1875571085780352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684199.866684:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:13774:x1875571085780352:12345-0@lo:502:llog_process_th.0 Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684199.866691:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788684199.866808:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13774:1875571085780352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788684199.866849:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684199.866858:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684199.866860:0:13774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788684199.866869:0:13774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d677cc6f800 00000020:00000080:1.0:1788684199.866872:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788684199.866926:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684199.866929:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684199.866931:0:13774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788684199.866933:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684199.866936:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684199.866937:0:13774:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788684199.866941:0:13774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d677cc6f800 00000020:00000080:1.0:1788684199.866942:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788684199.866971:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13774:1875571085780480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684199.867001:0:13774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684199.867019:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647707cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684199.870281:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085780480 00000100:00100000:0.0:1788684199.870295:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085780480 00000100:00100000:0.0:1788684199.870351:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788684199.870360:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:13774:x1875571085780480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684199.870521:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:13774:x1875571085780480:12345-0@lo:502:llog_process_th.0 Request processed in 162us (3518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684199.870529:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788684199.870753:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13774:1875571085780480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788684199.870789:0:13774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684199.870796:0:13774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684199.870798:0:13774:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788684199.870807:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788684199.870959:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788684199.870981:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684199.870990:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.871000:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684199.871009:0:6495:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684199.871012:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67466b4800 from 7 10000000:01000000:0.0:1788684199.871014:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684199.871040:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.871048:0:6495:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.871056:0:6495:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684199.871083:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.871115:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.871149:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777111b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684199.871208:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085780608 00000100:00100000:1.0:1788684199.871212:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085780608 00000100:00100000:1.0:1788684199.871241:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788684199.871256:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:6495:x1875571085780608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684199.871264:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684199.871275:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a1c00/0x44bac02bd54ac5f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ac5ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.871302:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1c00/0x44bac02bd54ac5f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ac5ec expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.871311:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a1c00/0x44bac02bd54ac5f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ac5ec expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684199.871320:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1c00, rc 0) 00000100:00100000:1.0:1788684199.871348:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085780608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684199.871354:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788684199.871939:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684199.871953:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684199.871961:0:6495:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684199.872011:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.872040:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.872062:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777111b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684199.872073:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085780736 00000100:00100000:0.0:1788684199.872076:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085780736 00000100:00100000:0.0:1788684199.872097:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788684199.872103:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085780736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.872186:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085780736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684199.872192:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788684199.872218:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.872240:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684199.874026:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684199.874280:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777111b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788684199.874461:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085780864 00000100:00100000:2.0:1788684199.874468:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085780864 00000100:00100000:1.0:1788684199.874745:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788684199.874755:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085780864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684199.874912:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:6495:x1875571085780864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684199.874919:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788684199.875213:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:eb0a8256-d625-4e80-aa6e-17b94cff8c50:6495:1875571085780864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684199.876424:0:13775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13775:1875571085780992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684199.876473:0:13775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684199.876505:0:13775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647707c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788684199.876943:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085780992 00000100:00100000:3.0:1788684199.876949:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085780992 00000100:00100000:3.0:1788684199.876989:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788684199.876997:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:13775:x1875571085780992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684199.877202:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:13775:x1875571085780992:12345-0@lo:502:llog_process_th.0 Request processed in 94us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684199.877215:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788684199.877356:0:13775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13775:1875571085780992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788684199.879709:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684199.879722:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684199.879724:0:13775:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788684199.879730:0:13775:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d67466b4800 00000020:00000080:3.0:1788684199.879732:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788684199.879968:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684199.879973:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684199.879974:0:13775:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788684199.879977:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684199.879979:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684199.879980:0:13775:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788684199.879984:0:13775:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d67466b4800 00000020:00000080:3.0:1788684199.879985:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:2.0:1788684199.881391:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788684199.885979:0:13775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13775:1875571085781120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684199.886063:0:13775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684199.886095:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085781120 00000100:00100000:3.0:1788684199.886100:0:13775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684199.886103:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085781120 00000100:00100000:1.0:1788684199.886154:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788684199.886164:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:13775:x1875571085781120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684199.886299:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:13775:x1875571085781120:12345-0@lo:502:llog_process_th.0 Request processed in 137us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684199.886306:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788684199.887445:0:13775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:eb0a8256-d625-4e80-aa6e-17b94cff8c50:13775:1875571085781120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788684199.887482:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684199.887490:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684199.887492:0:13775:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788684199.887497:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788684199.896424:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788684199.896460:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684199.896471:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684199.896483:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684200.183708:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684200.183800:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073115648 00000100:00100000:1.0:1788684200.183809:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073115648 00000100:00100000:1.0:1788684200.183874:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 355 00000100:00100000:1.0:1788684200.183884:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+11:6161:x1875571073115648:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684200.183901:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684200.183921:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ac5fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a3e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684200.183948:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ac5fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a3e expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684200.183959:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ac5fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a3e expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684200.183968:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0c00, rc 0) 00000100:00100000:1.0:1788684200.184021:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073115648:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 139us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684200.184029:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 355 00000100:00100000:0.0:1788684200.188937:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684200.189044:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073115776 00000100:00100000:3.0:1788684200.189070:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073115776 00000100:00100000:3.0:1788684200.189162:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 356 00000100:00100000:3.0:1788684200.189174:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073115776:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684200.189490:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073115776:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 317us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684200.189501:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 356 00000100:00100000:3.0:1788684200.195530:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684200.197323:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073115904 00000100:00100000:0.0:1788684200.197338:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073115904 00000100:00100000:0.0:1788684200.197444:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 357 00000100:00100000:0.0:1788684200.197454:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073115904:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684200.197599:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073115904:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 145us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684200.197607:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 357 00000100:00100000:2.0:1788684200.202593:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684200.202688:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073116032 00000100:00100000:1.0:1788684200.202705:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073116032 00000100:00100000:1.0:1788684200.202779:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 358 00000100:00100000:1.0:1788684200.202790:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+12:10777:x1875571073116032:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788684200.203016:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+12:10777:x1875571073116032:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 227us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684200.203035:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 358 00000100:00100000:2.0:1788684200.211323:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684200.211671:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073116160 00000100:00100000:0.0:1788684200.211680:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073116160 00000100:00100000:0.0:1788684200.211752:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 359 00000100:00100000:0.0:1788684200.211956:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+12:10777:x1875571073116160:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788684200.212106:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67801eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+12:10777:x1875571073116160:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 344us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684200.212114:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 359 00000100:00100000:0.0:1788684200.217754:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684200.218024:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073116288 00000100:00100000:3.0:1788684200.218034:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073116288 00000100:00100000:3.0:1788684200.218094:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 360 00000100:00100000:3.0:1788684200.218104:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+12:6161:x1875571073116288:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684200.218128:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684200.218148:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711ce00/0x44bac02bd54ac601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a45 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684200.218174:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711ce00/0x44bac02bd54ac601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a45 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684200.218185:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711ce00/0x44bac02bd54ac601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a45 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684200.218194:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711ce00, rc 0) 00000100:00100000:3.0:1788684200.218263:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073116288:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 160us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684200.218270:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 360 00000100:00100000:2.0:1788684200.223850:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684200.223948:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073116416 00000100:00100000:1.0:1788684200.223964:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073116416 00000100:00100000:1.0:1788684200.224051:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 361 00000100:00100000:1.0:1788684200.224080:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073116416:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684200.224288:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073116416:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 210us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684200.224296:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 361 00000100:00100000:2.0:1788684200.231086:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684200.231265:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073116544 00000100:00100000:0.0:1788684200.231274:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073116544 00000100:00100000:0.0:1788684200.231322:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 362 00000100:00100000:0.0:1788684200.231331:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073116544:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684200.231511:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:6161:x1875571073116544:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 180us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684200.231521:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 362 00000100:00100000:0.0:1788684200.235534:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684200.235695:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073116672 00000100:00100000:3.0:1788684200.235718:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073116672 00000100:00100000:3.0:1788684200.235802:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 363 00000100:00100000:3.0:1788684200.235813:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:10780:x1875571073116672:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684200.235974:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:10780:x1875571073116672:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 162us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684200.235982:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 363 00000100:00100000:2.0:1788684200.240585:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684200.240804:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073116800 00000100:00100000:1.0:1788684200.240814:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073116800 00000100:00100000:1.0:1788684200.240913:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 364 00000100:00100000:1.0:1788684200.240923:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:10780:x1875571073116800:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788684200.241062:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:10780:x1875571073116800:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 139us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684200.241070:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 364 00010000:00010000:0.0:1788684200.576701:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788684200.895573:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788684200.899894:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788684201.599027:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684201.657510:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684201.657551:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684201.657583:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684201.657769:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073116928 00000100:00100000:3.0:1788684201.657786:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073116928 00000100:00100000:2.0:1788684201.657795:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684201.657859:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073117184 00000100:00100000:2.0:1788684201.657868:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073117184 00000100:00100000:3.0:1788684201.657875:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 365 00000100:00100000:1.0:1788684201.657885:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073117440 00000100:00100000:1.0:1788684201.657893:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073117440 00000100:00100000:3.0:1788684201.657902:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073116928:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684201.657943:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073117056 00000100:00100000:1.0:1788684201.657948:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073117056 00000100:00100000:3.0:1788684201.658007:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073116928:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 112us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684201.658017:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 365 00000100:00100000:2.0:1788684201.658048:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 201 00000100:00100000:2.0:1788684201.658062:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073117440:12345-192.168.206.44@tcp:400:kworker.0 00000100:00080000:3.0:1788684201.658068:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684201.658076:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684201.658140:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 202 00000100:00100000:2.0:1788684201.658148:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073117440:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 88us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684201.658157:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073117184:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684201.658161:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 201 00000100:00100000:2.0:1788684201.658195:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 203 00000100:00100000:0.0:1788684201.658206:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073117184:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 54us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684201.658210:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073117056:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684201.658219:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 202 00000100:00100000:2.0:1788684201.658255:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073117056:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 49us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684201.658263:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 203 00000100:00100000:2.0:1788684201.662620:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684201.662669:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684201.662750:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073117312 00000100:00100000:3.0:1788684201.662758:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073117312 00000100:00080000:1.0:1788684201.662844:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684201.662881:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:3.0:1788684201.662892:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073117312:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684201.662965:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073117312:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 76us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684201.662973:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:0.0:1788684201.663045:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073117568 00000100:00100000:0.0:1788684201.663049:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073117568 00000100:00100000:0.0:1788684201.663084:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 204 00000100:00100000:0.0:1788684201.663092:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073117568:12345-192.168.206.44@tcp:400:kworker.0 00000100:00080000:1.0:1788684201.663101:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684201.663132:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073117568:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 40us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684201.663139:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 204 00010000:00010000:2.0:1788684202.622759:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684203.136284:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085781248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684203.136440:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684203.136758:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085781248 00000100:00100000:3.0:1788684203.136769:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085781248 00000100:00100000:3.0:1788684203.136852:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788684203.136864:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085781248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684203.136902:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684203.136956:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085781248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684203.136982:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788684203.137024:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788684203.137157:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66478f4380 x1875571085781248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684203.137181:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085781248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684203.137636:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085781632:0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.137682:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684203.137715:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085782144:0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.137754:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684203.137774:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085782656:0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.137797:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684203.137826:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788684203.137832:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085781760:0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.137856:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684203.137872:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085782272:0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.137890:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684203.137912:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085782784:0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.137931:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684203.137957:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085782144 00000100:00100000:0.0:1788684203.137962:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085782144 00000100:00100000:0.0:1788684203.138006:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085781760 00000100:00100000:0.0:1788684203.138009:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085781760 00000100:00100000:0.0:1788684203.138030:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788684203.138038:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085782144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.138084:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085782144:12345-0@lo:400:kworker.0 Request processed in 46us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684203.138091:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788684203.138107:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788684203.138112:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085781760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.138140:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085781760:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684203.138146:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788684203.138180:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085781760:0@lo:400:kworker.0 00010000:00080000:0.0:1788684203.138192:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772fb100 x1875571085782144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684203.138203:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085782144:0@lo:400:kworker.0 00000100:00100000:3.0:1788684203.139442:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085781504:0@lo:400:kworker.0 00000100:00100000:3.0:1788684203.139515:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684203.139826:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085782016:0@lo:400:kworker.0 00000100:00100000:3.0:1788684203.139857:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684203.139885:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085782528:0@lo:400:kworker.0 00000100:00100000:3.0:1788684203.139907:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684203.139934:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788684203.139941:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085781376:0@lo:400:kworker.0 00000100:00100000:3.0:1788684203.139969:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684203.139990:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085781888:0@lo:400:kworker.0 00000100:00100000:3.0:1788684203.140012:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684203.140028:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085782400:0@lo:400:kworker.0 00000100:00100000:3.0:1788684203.140045:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788684203.140071:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684203.140087:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085781504 00000100:00100000:3.0:1788684203.140094:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085781504 00000100:00100000:3.0:1788684203.140135:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085782016 00000100:00100000:3.0:1788684203.140138:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085782016 00000100:00100000:3.0:1788684203.140160:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085782528 00000100:00100000:3.0:1788684203.140163:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085782528 00000100:00100000:3.0:1788684203.140174:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085782400 00000100:00100000:3.0:1788684203.140176:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085782400 00000100:00100000:3.0:1788684203.140189:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788684203.140196:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085781504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.140399:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085781632 00000100:00100000:2.0:1788684203.140404:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085781632 00000100:00100000:2.0:1788684203.140446:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085781888 00000100:00100000:2.0:1788684203.140449:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085781888 00000100:00100000:2.0:1788684203.140463:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788684203.140469:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085781632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.140543:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788684203.140567:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085782016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684203.142137:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788684203.142154:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085782528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.144748:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085781632:12345-0@lo:400:kworker.0 Request processed in 4265us (7052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684203.144767:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788684203.144840:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788684203.144853:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085781888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.144920:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085781888:12345-0@lo:400:kworker.0 Request processed in 71us (4905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684203.144926:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788684203.144959:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085782656 00000100:00100000:2.0:1788684203.144968:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085782656 00000100:00100000:2.0:1788684203.145017:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085782272 00000100:00100000:2.0:1788684203.145021:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085782272 00000100:00100000:2.0:1788684203.145037:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085782784 00000100:00100000:2.0:1788684203.145040:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085782784 00000100:00100000:2.0:1788684203.145052:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788684203.145058:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085782656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.145092:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085782656:12345-0@lo:400:kworker.0 Request processed in 34us (7294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684203.145099:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788684203.145109:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788684203.145115:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085782272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.145164:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085782272:12345-0@lo:400:kworker.0 Request processed in 49us (7273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684203.145171:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788684203.145182:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788684203.145189:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085782784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.145218:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085782784:12345-0@lo:400:kworker.0 Request processed in 31us (7286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684203.145224:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788684203.145468:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085782912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684203.145520:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684203.145583:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1788684203.145593:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00080000:2.0:1788684203.145638:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684203.145643:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684203.145646:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684203.145649:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684203.145686:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085781888:0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.145836:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085781376 00000100:00100000:2.0:1788684203.145841:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085781376 00000100:00100000:2.0:1788684203.145873:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788684203.145879:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085781376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.145923:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085781376:12345-0@lo:400:kworker.0 Request processed in 44us (5952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684203.145929:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788684203.145964:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085781376:0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.145993:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085782912 00000100:00100000:2.0:1788684203.145996:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085782912 00000100:00100000:2.0:1788684203.146019:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788684203.146025:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085782912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684203.146041:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684203.146079:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085782912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684203.146086:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788684203.146116:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646711880 x1875571085782912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684203.146134:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085782912:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788684203.146213:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f9880 x1875571085782272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684203.146223:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085782272:0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.146442:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085782016:12345-0@lo:400:kworker.0 Request processed in 5889us (6582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684203.146452:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788684203.146495:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085782016:0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.146517:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788684203.146525:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085782400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684203.146566:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085782400:12345-0@lo:400:kworker.0 Request processed in 42us (6519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684203.146572:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788684203.146597:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085782400:0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.146948:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085782784:0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.146969:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085781632:0@lo:400:kworker.0 00000100:00100000:2.0:1788684203.146983:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085782656:0@lo:400:kworker.0 00000100:00100000:3.0:1788684203.152153:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085781504:12345-0@lo:400:kworker.0 Request processed in 11941us (12622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684203.152171:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788684203.152485:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085781504:0@lo:400:kworker.0 00000100:00100000:1.0:1788684203.152877:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085782528:12345-0@lo:400:kworker.0 Request processed in 10726us (12966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684203.152886:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00080000:0.0:1788684203.152962:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fb59500 x1875571085782528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684203.152974:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085782528:0@lo:400:kworker.0 00000100:00100000:1.0:1788684203.645869:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788684203.645898:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085783168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684203.645991:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684203.646120:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085783168 00000100:00100000:1.0:1788684203.646129:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085783168 00000100:00100000:1.0:1788684203.646189:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788684203.646199:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085783168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684203.646238:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684203.646288:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085783168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684203.646296:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788684203.646383:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085783168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684203.647121:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085783040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684203.647207:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684203.647667:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684203.647726:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085783040 00000100:00100000:1.0:1788684203.647736:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085783040 00000100:00100000:1.0:1788684203.647789:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788684203.647798:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875571085783040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684203.647834:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684203.647901:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875571085783040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684203.647908:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788684203.648033:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085783040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684203.648297:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085783296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684203.648340:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684203.648654:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085783296 00000100:00100000:3.0:1788684203.648660:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085783296 00000100:00100000:3.0:1788684203.648708:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788684203.648717:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085783296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684203.648750:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788684203.648853:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085783296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684203.648860:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788684203.648949:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085783296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684204.157698:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085783424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684204.157795:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684204.158112:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085783424 00000100:00100000:2.0:1788684204.158124:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085783424 00000100:00100000:2.0:1788684204.158193:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788684204.158204:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085783424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684204.158249:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788684204.158430:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085783424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 226us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684204.158749:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788684204.159889:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085783424:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788684204.164129:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1788684204.671117:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684205.694761:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684206.720614:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684206.775617:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684206.775659:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684206.775693:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684206.775716:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684206.775739:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684206.775776:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073117952 00000100:00100000:3.0:1788684206.775788:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073117952 00000100:00100000:2.0:1788684206.775788:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684206.775825:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073118208 00000100:00100000:2.0:1788684206.775830:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073118208 00000100:00100000:0.0:1788684206.775913:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073117696 00000100:00100000:0.0:1788684206.775918:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073117696 00000100:00100000:0.0:1788684206.775953:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 367 00000100:00100000:0.0:1788684206.775963:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073117696:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684206.776045:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073117696:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 84us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684206.776054:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 367 00000100:00100000:2.0:1788684206.776205:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073117824 00000100:00100000:2.0:1788684206.776209:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073117824 00000100:00100000:3.0:1788684206.778457:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073118336 00000100:00100000:3.0:1788684206.778474:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073118336 00000100:00100000:3.0:1788684206.778537:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 211 00000100:00100000:3.0:1788684206.778548:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073118208:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684206.778646:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073118208:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 99us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684206.778655:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 211 00000100:00100000:3.0:1788684206.778674:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 212 00000100:00100000:3.0:1788684206.778680:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073117952:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684206.778918:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073117952:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 236us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684206.778925:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 212 00000100:00100000:3.0:1788684206.778942:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 213 00000100:00100000:3.0:1788684206.778948:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073117824:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684206.778974:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073117824:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684206.778980:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 213 00000100:00100000:3.0:1788684206.778992:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 214 00000100:00100000:3.0:1788684206.778998:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073118336:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684206.779021:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073118336:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (3235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684206.779028:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 214 00000100:00080000:3.0:1788684206.779090:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684206.779097:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684206.779109:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073118080 00000100:00100000:3.0:1788684206.779114:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073118080 00000100:00100000:3.0:1788684206.779225:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:3.0:1788684206.779232:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073118080:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684206.779261:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073118080:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 30us (3522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684206.779268:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00080000:3.0:1788684206.779283:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788684207.741917:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684208.253986:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684208.254019:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085783552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684208.254019:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085783680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684208.254252:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085783808:0@lo:400:kworker.0 00000100:00100000:3.0:1788684208.254254:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085784064:0@lo:400:kworker.0 00000100:00100000:0.0:1788684208.260106:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684208.260225:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085784192:0@lo:400:kworker.0 00000100:00100000:0.0:1788684208.260263:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684208.260291:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085784704:0@lo:400:kworker.0 00000100:00100000:0.0:1788684208.260314:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684208.260337:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085785216:0@lo:400:kworker.0 00000100:00100000:0.0:1788684208.260356:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684208.260418:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085784704 00000100:00100000:0.0:1788684208.260427:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085784704 00000100:00100000:2.0:1788684208.260863:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085785216 00000100:00100000:2.0:1788684208.260871:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085785216 00000100:00100000:2.0:1788684208.260927:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788684208.260939:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085785216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261011:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085785216:12345-0@lo:400:kworker.0 Request processed in 76us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684208.261020:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788684208.261059:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684208.261098:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085783936:0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261125:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684208.261148:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085784448:0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261171:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684208.261197:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085784960:0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261221:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684208.261276:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684208.261281:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684208.261292:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085784192 00000100:00100000:2.0:1788684208.261296:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085784192 00000100:00100000:2.0:1788684208.261324:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085783936 00000100:00100000:2.0:1788684208.261327:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085783936 00000100:00100000:2.0:1788684208.261344:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085784448 00000100:00100000:2.0:1788684208.261347:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085784448 00000100:00100000:2.0:1788684208.261362:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085784960 00000100:00100000:2.0:1788684208.261384:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085784960 00000100:00100000:2.0:1788684208.261401:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788684208.261406:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085784192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261461:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085784192:12345-0@lo:400:kworker.0 Request processed in 55us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684208.261468:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788684208.261481:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788684208.261487:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085783936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261519:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085783936:12345-0@lo:400:kworker.0 Request processed in 32us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684208.261525:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788684208.261536:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788684208.261543:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085784448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261569:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085784448:12345-0@lo:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684208.261575:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788684208.261586:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788684208.261592:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085784960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261618:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085784960:12345-0@lo:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684208.261624:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1788684208.261641:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684208.261675:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085783936:0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261685:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085784448:0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261694:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085784960:0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261761:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085783680 00000100:00100000:2.0:1788684208.261765:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085783680 00000100:00100000:2.0:1788684208.261811:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085783552 00000100:00100000:2.0:1788684208.261815:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085783552 00000100:00100000:2.0:1788684208.261827:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788684208.261834:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085783680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684208.261861:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684208.261904:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085783680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684208.261911:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788684208.261916:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788684208.261925:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3623:x1875571085784704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.261934:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788684208.261942:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085783552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684208.261953:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684208.261980:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3623:x1875571085784704:12345-0@lo:400:kworker.0 Request processed in 58us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684208.261988:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788684208.261997:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085783552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684208.262006:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1788684208.262025:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684208.262053:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085784192:0@lo:400:kworker.0 00010000:00080000:2.0:1788684208.262069:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a8c380 x1875571085784704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684208.262079:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085784704:0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.262089:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085785216:0@lo:400:kworker.0 00010000:00080000:2.0:1788684208.262100:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a7100 x1875571085783680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684208.262115:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085783680:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788684208.262143:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6780030380 x1875571085783552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684208.262162:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085783552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684208.262204:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684208.262245:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085784320:0@lo:400:kworker.0 00000100:00100000:1.0:1788684208.262271:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684208.262303:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085784320 00000100:00100000:1.0:1788684208.262307:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085784320 00000100:00100000:1.0:1788684208.262334:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788684208.262340:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085784320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684208.262389:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085784320:12345-0@lo:400:kworker.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684208.262396:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788684208.262428:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085784320:0@lo:400:kworker.0 00000100:00100000:1.0:1788684208.262435:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085784832:0@lo:400:kworker.0 00000100:00100000:1.0:1788684208.262456:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684208.262476:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085784832 00000100:00100000:1.0:1788684208.262479:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085784832 00000100:00100000:1.0:1788684208.262498:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788684208.262504:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085784832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684208.262529:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085784832:12345-0@lo:400:kworker.0 Request processed in 25us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684208.262535:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1788684208.262555:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a8c000 x1875571085784832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684208.262564:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085784832:0@lo:400:kworker.0 00000100:00100000:1.0:1788684208.262571:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085785344:0@lo:400:kworker.0 00000100:00100000:1.0:1788684208.262591:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684208.262678:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085785344 00000100:00100000:0.0:1788684208.262682:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085785344 00000100:00100000:0.0:1788684208.262717:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788684208.262723:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085785344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684208.262754:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085785344:12345-0@lo:400:kworker.0 Request processed in 31us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684208.262760:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788684208.263558:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684208.263616:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085784576:0@lo:400:kworker.0 00000100:00100000:3.0:1788684208.263647:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788684208.263898:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684208.263922:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085785088:0@lo:400:kworker.0 00000100:00100000:3.0:1788684208.263959:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684208.263964:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788684208.263973:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d677fa6aa00, transno 4294967301 00000100:00100000:1.0:1788684208.263990:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085785344:0@lo:400:kworker.0 00000100:00100000:3.0:1788684208.264027:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085784576 00000100:00100000:3.0:1788684208.264036:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085784576 00000100:00100000:1.0:1788684208.264064:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085785088 00000100:00100000:1.0:1788684208.264071:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085785088 00000100:00100000:3.0:1788684208.264108:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788684208.264122:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085784576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684208.264128:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788684208.264145:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085785088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684208.264205:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085784576:12345-0@lo:400:kworker.0 Request processed in 82us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684208.264217:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085785088:12345-0@lo:400:kworker.0 Request processed in 72us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684208.264218:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788684208.264236:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:3.0:1788684208.264270:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788684208.264308:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66477ece00 x1875571085784576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684208.264322:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085784576:0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.264435:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085783808 00000100:00100000:2.0:1788684208.264442:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085783808 00000100:00100000:2.0:1788684208.264483:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788684208.264490:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085783808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684208.264529:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085783808:12345-0@lo:400:kworker.0 Request processed in 40us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684208.264535:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788684208.264913:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085784064 00000100:00100000:0.0:1788684208.264921:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085784064 00000100:00100000:0.0:1788684208.264970:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788684208.264978:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085784064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684208.265046:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085784064:12345-0@lo:400:kworker.0 Request processed in 69us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684208.265053:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:3.0:1788684208.265240:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a8ca80 x1875571085785088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684208.265256:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085785088:0@lo:400:kworker.0 00000100:00100000:3.0:1788684208.265283:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085784064:0@lo:400:kworker.0 00000100:00100000:1.0:1788684208.267178:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085783808:0@lo:400:kworker.0 00000100:00100000:3.0:1788684208.766303:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085785472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684208.766417:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684208.766497:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788684208.766666:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085785600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684208.766728:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684208.767000:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085785472 00000100:00100000:2.0:1788684208.767009:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085785472 00000100:00100000:2.0:1788684208.767065:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788684208.767076:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085785472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684208.767115:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684208.767171:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085785472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684208.767179:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:1.0:1788684208.767313:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684208.767328:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085785600 00000100:00100000:1.0:1788684208.767332:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085785600 00000100:00100000:1.0:1788684208.767386:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788684208.767394:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085785600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684208.767425:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684208.767465:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085785600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684208.767473:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788684208.767762:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684208.767774:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085785728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684208.767822:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684208.769737:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085785728 00000100:00100000:2.0:1788684208.769754:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085785728 00000100:00100000:2.0:1788684208.769828:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788684208.769839:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085785728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684208.769866:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684208.769959:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085785728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684208.769967:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788684208.770136:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085785728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684208.772742:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085785600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684208.772826:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085785472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684209.277968:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085785856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684209.278077:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684209.278424:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085785856 00000100:00100000:2.0:1788684209.278451:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085785856 00000100:00100000:2.0:1788684209.278528:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788684209.278540:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085785856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684209.278590:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788684209.278658:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085785856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684209.278666:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788684209.279452:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085785856:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788684209.789642:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788684210.114197:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788684210.115575:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788684210.813669:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684211.837731:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684211.898703:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684211.898751:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684211.898808:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684211.898844:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684211.898862:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684211.898888:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684211.898927:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073118592 00000100:00100000:1.0:1788684211.898940:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073118592 00000100:00100000:1.0:1788684211.899010:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073119104 00000100:00100000:1.0:1788684211.899013:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073119104 00000100:00100000:1.0:1788684211.899034:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073118720 00000100:00100000:1.0:1788684211.899036:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073118720 00000100:00100000:1.0:1788684211.899049:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073118976 00000100:00100000:1.0:1788684211.899051:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073118976 00000100:00100000:1.0:1788684211.899067:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 221 00000100:00100000:1.0:1788684211.899078:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073118592:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684211.899122:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073118848 00000100:00100000:2.0:1788684211.899139:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073118848 00000100:00100000:1.0:1788684211.899186:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073118592:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 108us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684211.899196:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 221 00000100:00100000:1.0:1788684211.899234:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 222 00000100:00100000:2.0:1788684211.899243:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:1.0:1788684211.899248:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073119104:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684211.899263:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073118848:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684211.899286:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073119104:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 42us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684211.899296:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 222 00000100:00100000:1.0:1788684211.899314:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 223 00000100:00100000:1.0:1788684211.899322:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073118720:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684211.899340:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073118848:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 81us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684211.899350:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:1.0:1788684211.899358:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073118720:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684211.899430:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 223 00000100:00100000:1.0:1788684211.899463:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 224 00000100:00100000:1.0:1788684211.899471:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073118976:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684211.899507:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073118976:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684211.899515:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 224 00000100:00100000:3.0:1788684211.900018:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073118464 00000100:00100000:3.0:1788684211.900026:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073118464 00000100:00100000:3.0:1788684211.900077:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 369 00000100:00100000:3.0:1788684211.900084:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073118464:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684211.900140:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073118464:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 57us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684211.900148:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 369 00000100:00080000:3.0:1788684211.900182:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684211.900188:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684211.900190:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788684212.862633:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684213.373640:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085786112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684213.373659:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085786240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684213.373845:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085785984:0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.373946:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684213.374044:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085786240 00000100:00100000:3.0:1788684213.374052:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085786240 00000100:00100000:3.0:1788684213.374101:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788684213.374110:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085786240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684213.374140:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684213.374182:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085786240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684213.374189:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788684213.374206:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788684213.374231:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6751bc1180 x1875571085786240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684213.374265:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085786240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684213.374482:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085786368:0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.374526:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684213.374561:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085786880:0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.374585:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684213.374687:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085786368 00000100:00100000:1.0:1788684213.374697:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085786368 00000100:00100000:1.0:1788684213.374749:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085786880 00000100:00100000:1.0:1788684213.374753:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085786880 00000100:00100000:0.0:1788684213.374779:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684213.374806:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788684213.374818:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085786368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.374831:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085786624:0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.374844:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085787392:0@lo:400:kworker.0 00000100:00100000:1.0:1788684213.377719:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085786368:12345-0@lo:400:kworker.0 Request processed in 83us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684213.379431:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788684213.379460:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085786880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.379558:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085786880:12345-0@lo:400:kworker.0 Request processed in 111us (4970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684213.381441:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684213.381512:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085787136:0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.381572:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684213.381586:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684213.381606:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085787648:0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.381653:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684213.381758:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788684213.381781:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085786496:0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.381814:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684213.381925:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085787008:0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.381952:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684213.381971:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6743368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085787520:0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.381990:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684213.382029:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085786624 00000100:00100000:0.0:1788684213.382051:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085786624 00000100:00100000:2.0:1788684213.382523:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085786752:0@lo:400:kworker.0 00000100:00100000:2.0:1788684213.382592:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684213.382622:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085787264:0@lo:400:kworker.0 00000100:00100000:2.0:1788684213.382649:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684213.382682:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085786496 00000100:00100000:2.0:1788684213.382689:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085786496 00000100:00100000:2.0:1788684213.382738:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085786752 00000100:00100000:2.0:1788684213.382741:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085786752 00000100:00100000:2.0:1788684213.382770:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788684213.382781:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085786496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684213.382840:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788684213.382889:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085785984 00000100:00100000:1.0:1788684213.382896:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085785984 00000100:00100000:2.0:1788684213.382901:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085786496:12345-0@lo:400:kworker.0 Request processed in 119us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684213.382909:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788684213.382929:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788684213.382936:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788684213.382939:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085786752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684213.382960:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085785984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684213.384088:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085786752:12345-0@lo:400:kworker.0 Request processed in 1144us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684213.384099:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788684213.384178:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085786752:0@lo:400:kworker.0 00000100:00100000:1.0:1788684213.384218:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085785984:12345-0@lo:400:kworker.0 Request processed in 1260us (7951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684213.384221:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085787008 00000100:00100000:2.0:1788684213.384229:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085787008 00000100:00100000:1.0:1788684213.384229:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788684213.384276:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085787264 00000100:00100000:1.0:1788684213.384281:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085787264 00000100:00100000:3.0:1788684213.389419:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788684213.389489:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684213.389594:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085787136 00000100:00100000:0.0:1788684213.389603:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085787136 00000100:00100000:0.0:1788684213.389644:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085787648 00000100:00100000:0.0:1788684213.389647:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085787648 00000100:00100000:0.0:1788684213.389660:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085787520 00000100:00100000:0.0:1788684213.389662:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085787520 00000100:00100000:0.0:1788684213.389677:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788684213.389685:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085787136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.389753:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085787136:12345-0@lo:400:kworker.0 Request processed in 69us (8182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684213.389774:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788684213.389787:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788684213.389792:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677e51c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085787648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.389821:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677e51c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085787648:12345-0@lo:400:kworker.0 Request processed in 29us (8169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684213.389827:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788684213.389864:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085786880:0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.389881:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085786368:0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.389922:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085787392 00000100:00100000:3.0:1788684213.389927:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085787392 00000100:00100000:3.0:1788684213.389958:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788684213.389968:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085786624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.390015:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085786624:12345-0@lo:400:kworker.0 Request processed in 49us (15124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684213.390024:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788684213.390046:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788684213.390053:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788684213.390058:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085787392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.390068:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085787520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684213.390084:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788684213.390110:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085787008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.390141:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085787392:12345-0@lo:400:kworker.0 Request processed in 85us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684213.390142:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085787520:12345-0@lo:400:kworker.0 Request processed in 80us (8148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684213.390161:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788684213.390162:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788684213.390216:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646711880 x1875571085787392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684213.390230:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085787392:0@lo:400:kworker.0 00000100:00100000:2.0:1788684213.390235:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085787008:12345-0@lo:400:kworker.0 Request processed in 134us (8277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684213.390247:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788684213.390300:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085785984:0@lo:400:kworker.0 00000100:00100000:2.0:1788684213.390661:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085786112 00000100:00100000:0.0:1788684213.390669:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085786496:0@lo:400:kworker.0 00000100:00100000:2.0:1788684213.390675:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085786112 00010000:00080000:0.0:1788684213.390690:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a8c700 x1875571085787008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684213.390704:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085787008:0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.390721:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6743368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085787520:0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.390742:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085786624:0@lo:400:kworker.0 00010000:00080000:0.0:1788684213.390752:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a8c380 x1875571085787136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684213.390772:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085787136:0@lo:400:kworker.0 00000100:00100000:0.0:1788684213.390783:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085787648:0@lo:400:kworker.0 00000100:00100000:2.0:1788684213.390818:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788684213.390830:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085786112:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788684213.390833:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684213.390841:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684213.390845:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684213.390848:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:2.0:1788684213.390854:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684213.390914:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085786112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (16134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684213.390924:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788684213.390936:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6780031f80 x1875571085786112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684213.390954:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085786112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684213.391616:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788684213.391635:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085787264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684213.391703:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085787264:12345-0@lo:400:kworker.0 Request processed in 75us (9052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684213.391728:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788684213.391863:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085787264:0@lo:400:kworker.0 00000100:00100000:3.0:1788684213.885647:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684213.885672:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085787776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684213.885743:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684213.885875:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684213.886095:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085787776 00000100:00100000:0.0:1788684213.886111:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085787776 00000100:00100000:0.0:1788684213.886184:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788684213.886196:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085787776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788684213.886240:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788684213.887170:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085787776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 971us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684213.887181:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788684213.887386:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684213.887403:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6743368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085787904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684213.887452:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684213.888938:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085787776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684213.889112:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085787904 00000100:00100000:2.0:1788684213.889119:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085787904 00000100:00100000:2.0:1788684213.889177:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788684213.889186:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085787904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684213.889226:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684213.889290:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085787904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684213.889297:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788684213.889649:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085788032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684213.889687:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684213.889821:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6743368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085787904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684213.890137:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085788032 00000100:00100000:2.0:1788684213.890143:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085788032 00000100:00100000:2.0:1788684213.890274:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788684213.890283:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085788032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684213.890296:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684213.890351:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085788032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684213.890358:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788684213.894282:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085788032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684214.399784:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684214.399817:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085788160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684214.399882:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684214.400120:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085788160 00000100:00100000:2.0:1788684214.400128:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085788160 00000100:00100000:2.0:1788684214.400182:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788684214.400191:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085788160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684214.400222:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788684214.400275:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085788160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684214.400282:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788684214.400363:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085788160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788684214.909669:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684215.933901:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684216.957637:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684217.016322:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684217.016410:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684217.016451:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684217.016533:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073119232 00000100:00100000:2.0:1788684217.016543:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073119232 00000100:00100000:2.0:1788684217.016589:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 371 00000100:00100000:2.0:1788684217.016599:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073119232:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684217.016666:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073119232:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 68us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684217.016689:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 371 00000100:00100000:2.0:1788684217.016725:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073119488 00000100:00100000:2.0:1788684217.016728:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073119488 00000100:00100000:2.0:1788684217.016780:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073119360 00000100:00100000:2.0:1788684217.016783:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073119360 00000100:00100000:2.0:1788684217.016799:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 231 00000100:00100000:2.0:1788684217.016804:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073119488:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684217.016835:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073119488:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 31us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684217.016840:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 231 00000100:00100000:2.0:1788684217.016864:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 232 00000100:00100000:2.0:1788684217.016870:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073119360:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684217.016893:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073119360:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684217.016899:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 232 00000100:00080000:0.0:1788684217.017824:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684217.017831:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788684217.029547:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684217.029597:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684217.029685:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684217.029780:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073119744 00000100:00100000:3.0:1788684217.029799:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073119744 00000100:00100000:2.0:1788684217.029801:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073119872 00000100:00100000:2.0:1788684217.029813:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073119872 00000100:00100000:0.0:1788684217.029887:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073119616 00000100:00100000:0.0:1788684217.029893:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073119616 00000100:00100000:3.0:1788684217.029984:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 233 00000100:00100000:3.0:1788684217.030000:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073119744:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684217.030103:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073119744:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 108us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684217.030111:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 233 00000100:00100000:2.0:1788684217.032588:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 234 00000100:00100000:2.0:1788684217.032603:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073119872:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684217.032686:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073119872:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 87us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684217.032693:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 234 00000100:00100000:0.0:1788684217.033305:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:0.0:1788684217.033315:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2389:x1875571073119616:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:0.0:1788684217.033336:0:8413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac528 00000100:00080000:0.0:1788684217.033346:0:8413:0:(import.c:65:import_set_state_nolock()) ffff8d6647898800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684217.033418:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1788684217.033556:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+2:2389:x1875571073119616:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 242us (4017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684217.033562:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00010000:00010000:0.0:1788684217.033601:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788684217.041058:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788684217.041074:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684217.041078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788684217.981670:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684218.493757:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684218.493780:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085788288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684218.493848:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684218.494063:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085788288 00000100:00100000:2.0:1788684218.494070:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085788288 00000100:00100000:2.0:1788684218.494133:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788684218.494153:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085788288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684218.494190:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684218.494229:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085788288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684218.494242:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788684218.494393:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684218.494556:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085788416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684218.494590:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788684218.494619:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6780030700 x1875571085788288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684218.494636:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085788288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684218.496573:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085788928:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.496873:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085788800:0@lo:400:kworker.0 00000100:00100000:3.0:1788684218.496996:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085788544:0@lo:400:kworker.0 00000100:00100000:2.0:1788684218.497017:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085788416 00000100:00100000:2.0:1788684218.497031:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085788416 00000100:00100000:2.0:1788684218.497108:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788684218.497119:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085788416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684218.497142:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684218.501991:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684218.502088:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085789312:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.502140:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684218.502166:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085789824:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.502191:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684218.502260:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085788800 00000100:00100000:1.0:1788684218.502270:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085788800 00000100:00100000:1.0:1788684218.502331:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788684218.502341:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085788800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.502428:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085788800:12345-0@lo:400:kworker.0 Request processed in 87us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.502455:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788684218.502485:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085789312 00000100:00100000:1.0:1788684218.502490:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085789312 00000100:00100000:1.0:1788684218.502529:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788684218.502535:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085789312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.502572:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085789312:12345-0@lo:400:kworker.0 Request processed in 36us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.502578:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788684218.502644:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085788800:0@lo:400:kworker.0 00010000:00080000:1.0:1788684218.502662:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647564000 x1875571085789312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684218.502685:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085789312:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.502718:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085788672:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.502768:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684218.502792:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677718ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085789184:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.502813:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684218.502833:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085789696:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.502856:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684218.502891:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085789824 00000100:00100000:1.0:1788684218.502896:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085789824 00000100:00100000:1.0:1788684218.502926:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085789696 00000100:00100000:1.0:1788684218.502929:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085789696 00000100:00100000:1.0:1788684218.502951:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788684218.502958:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085789824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.503006:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085789824:12345-0@lo:400:kworker.0 Request processed in 49us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.503013:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788684218.503024:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684218.503029:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085789696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.503060:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085789696:12345-0@lo:400:kworker.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.503066:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684218.503094:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085788672 00000100:00100000:1.0:1788684218.503100:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085788672 00000100:00100000:0.0:1788684218.503253:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788684218.506697:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684218.506712:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684218.506716:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684218.507196:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085789440:0@lo:400:kworker.0 00000100:00100000:0.0:1788684218.507283:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684218.508526:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085789184 00000100:00100000:1.0:1788684218.508543:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085789184 00000100:00100000:1.0:1788684218.508856:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085788928 00000100:00100000:1.0:1788684218.508861:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085788928 00000100:00100000:1.0:1788684218.509012:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788684218.509134:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085788672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.509246:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085788672:12345-0@lo:400:kworker.0 Request processed in 223us (6476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.509253:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788684218.509276:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788684218.509284:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085789184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.509314:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085789184:12345-0@lo:400:kworker.0 Request processed in 32us (6500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.509319:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788684218.509331:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788684218.509337:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085788928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.509410:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085788928:12345-0@lo:400:kworker.0 Request processed in 73us (6156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.509416:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788684218.509487:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085789824:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.509525:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085788672:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.509536:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677718ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085789184:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.509549:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085789696:0@lo:400:kworker.0 00000100:00080000:1.0:1788684218.509817:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684218.510516:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085788928:0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.510725:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085789440 00000100:00100000:1.0:1788684218.511061:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085789440 00000100:00100000:1.0:1788684218.511180:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788684218.511189:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085789440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.511269:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085789440:12345-0@lo:400:kworker.0 Request processed in 81us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.511276:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788684218.511330:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085789440:0@lo:400:kworker.0 00000100:00100000:3.0:1788684218.511455:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684218.511494:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085789056:0@lo:400:kworker.0 00000100:00100000:3.0:1788684218.511536:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684218.511561:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085789568:0@lo:400:kworker.0 00000100:00100000:3.0:1788684218.511587:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684218.511624:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085789568 00000100:00100000:3.0:1788684218.511629:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085789568 00000100:00100000:1.0:1788684218.511689:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085788544 00000100:00100000:1.0:1788684218.511693:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085788544 00000100:00100000:1.0:1788684218.511724:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788684218.511730:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085788544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.511786:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085788544:12345-0@lo:400:kworker.0 Request processed in 55us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.511793:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788684218.511840:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085789056 00000100:00100000:1.0:1788684218.511857:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085789056 00000100:00100000:1.0:1788684218.511886:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788684218.511893:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085789056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684218.511928:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085789056:12345-0@lo:400:kworker.0 Request processed in 36us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684218.511935:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788684218.514754:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085788416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17629us (20155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684218.514767:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788684218.514845:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085788544:0@lo:400:kworker.0 00000100:00100000:2.0:1788684218.514859:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085789056:0@lo:400:kworker.0 00000100:00080000:0.0:1788684218.516873:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684218.516887:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684218.517338:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788684218.517354:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085789568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684218.517497:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085789568:12345-0@lo:400:kworker.0 Request processed in 148us (5907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684218.517507:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00010000:00080000:2.0:1788684218.520068:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647565880 x1875571085789568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684218.520093:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085789568:0@lo:400:kworker.0 00010000:00080000:1.0:1788684218.521747:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fb5ad80 x1875571085788416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684218.521775:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085788416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684219.005958:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684219.005985:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085789952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684219.006059:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085790080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684219.006066:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684219.006142:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684219.006166:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085789952 00000100:00100000:1.0:1788684219.006175:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085789952 00000100:00100000:1.0:1788684219.006234:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788684219.006247:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085789952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684219.006278:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684219.006315:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085790080 00000100:00100000:3.0:1788684219.006324:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085790080 00000100:00100000:1.0:1788684219.006339:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085789952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684219.006349:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788684219.006402:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788684219.006417:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085790080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684219.006455:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684219.006457:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085789952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684219.006795:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085790208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684219.006831:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684219.006892:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684219.006908:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085790208 00000100:00100000:1.0:1788684219.006913:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085790208 00000100:00100000:1.0:1788684219.006964:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788684219.006971:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085790208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684219.006987:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684219.007020:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085790208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684219.007027:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788684219.007054:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085790208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684219.011703:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085790080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5276us (5548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684219.011721:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788684219.012120:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085790080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684219.520266:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085790336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684219.520409:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684219.520485:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085790336 00000100:00100000:0.0:1788684219.520507:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085790336 00000100:00100000:0.0:1788684219.520575:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788684219.520587:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085790336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684219.520619:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788684219.520702:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085790336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684219.520709:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788684219.520886:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085790336:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788684220.029929:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788684220.349999:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788684220.350848:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788684221.072289:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684222.082662:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684222.140995:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684222.141044:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684222.141072:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684222.141092:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684222.141133:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684222.141162:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073120256 00000100:00100000:1.0:1788684222.141171:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073120256 00000100:00100000:1.0:1788684222.141225:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073120512 00000100:00100000:1.0:1788684222.141229:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073120512 00000100:00100000:1.0:1788684222.141249:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073120128 00000100:00100000:1.0:1788684222.141252:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073120128 00000100:00100000:1.0:1788684222.141264:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073120384 00000100:00100000:1.0:1788684222.141266:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073120384 00000100:00100000:1.0:1788684222.141282:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 241 00000100:00100000:1.0:1788684222.141292:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073120256:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684222.141362:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073120256:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684222.141403:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 241 00000100:00100000:1.0:1788684222.141422:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 242 00000100:00100000:1.0:1788684222.141429:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073120512:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684222.141460:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073120512:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684222.141466:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 242 00000100:00100000:1.0:1788684222.141479:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 243 00000100:00100000:1.0:1788684222.141485:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073120128:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684222.141511:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073120128:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684222.141517:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 243 00000100:00100000:1.0:1788684222.141529:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:1.0:1788684222.141536:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677718ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073120384:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684222.141559:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677718ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073120384:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684222.141565:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00080000:1.0:1788684222.141589:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684222.141593:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684222.141787:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073120000 00000100:00100000:0.0:1788684222.141792:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073120000 00000100:00100000:0.0:1788684222.141830:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 373 00000100:00100000:0.0:1788684222.141837:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073120000:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684222.141872:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073120000:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 36us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684222.141879:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 373 00010000:00010000:3.0:1788684223.103123:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788684223.112278:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:1.0:1788684223.112288:0:9488:0:(genops.c:885:class_export_put()) final put ffff8d664789a000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:0.0:1788684223.112361:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664789a000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e for lustre-OST0001 00000020:00000080:0.0:1788684223.112446:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6647898800 for lustre-OST0001 00000100:00100000:0.0:1788684223.619576:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684223.619596:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085790464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684223.619742:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684223.619803:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085790592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684223.619828:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684223.619873:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085790464 00000100:00100000:0.0:1788684223.619879:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085790464 00000100:00100000:0.0:1788684223.619920:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085790592 00000100:00100000:0.0:1788684223.619922:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085790592 00000100:00100000:0.0:1788684223.619937:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788684223.619944:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085790464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684223.619970:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684223.620010:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085790464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684223.620017:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788684223.620034:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788684223.620046:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085790592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788684223.621763:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684223.621862:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085790592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1818us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684223.621871:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788684223.621907:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788684223.621942:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647566d80 x1875571085790464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684223.621964:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085790464:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788684223.622935:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647566300 x1875571085790592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684223.622953:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085790592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684223.626237:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684223.626260:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085790848:0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.626395:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684223.626454:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085790848 00000100:00100000:3.0:1788684223.626461:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085790848 00000100:00100000:3.0:1788684223.626506:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788684223.626514:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085790848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.626565:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085790848:12345-0@lo:400:kworker.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684223.626573:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788684223.626614:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085790848:0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.626651:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085790976:0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.626679:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684223.626817:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67770e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085790720:0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.626852:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684223.627573:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085790976 00000100:00100000:3.0:1788684223.627581:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085790976 00000100:00100000:1.0:1788684223.627651:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085790720 00000100:00100000:1.0:1788684223.627655:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085790720 00000100:00100000:1.0:1788684223.627691:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788684223.627699:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085790720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.627767:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085790720:12345-0@lo:400:kworker.0 Request processed in 68us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684223.627774:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788684223.627821:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085790720:0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.628772:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788684223.628783:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085790976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.628840:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085790976:12345-0@lo:400:kworker.0 Request processed in 60us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684223.628847:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788684223.628885:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67770e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085790976:0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.628900:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684223.628908:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085791360:0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.628939:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684223.628971:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085791360 00000100:00100000:3.0:1788684223.628988:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085791360 00000100:00100000:3.0:1788684223.629027:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788684223.629034:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085791360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.629069:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085791360:12345-0@lo:400:kworker.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684223.629074:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1788684223.629090:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684223.629280:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085791104:0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.629311:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684223.629333:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684223.629339:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085791232:0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.629363:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684223.629493:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085791104 00000100:00100000:1.0:1788684223.629498:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085791104 00000100:00100000:1.0:1788684223.629524:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788684223.629531:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085791104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.629569:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085791104:12345-0@lo:400:kworker.0 Request processed in 38us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684223.629575:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788684223.629592:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085791232 00000100:00100000:1.0:1788684223.629595:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085791232 00000100:00100000:1.0:1788684223.629617:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788684223.629623:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67770e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085791232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.629664:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67770e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085791232:12345-0@lo:400:kworker.0 Request processed in 39us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684223.629670:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788684223.629700:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085791232:0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.629723:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085791104:0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.629894:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085791360:0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.630331:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085791488:0@lo:400:kworker.0 00000100:00100000:3.0:1788684223.630404:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684223.630953:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085791488 00000100:00100000:1.0:1788684223.630961:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085791488 00000100:00100000:1.0:1788684223.631016:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788684223.631024:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085791488:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788684223.631090:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684223.631173:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085791616:0@lo:400:kworker.0 00000100:00100000:2.0:1788684223.631204:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684223.631778:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085791488:12345-0@lo:400:kworker.0 Request processed in 753us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684223.631786:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788684223.631804:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085791616 00000100:00100000:1.0:1788684223.631808:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085791616 00000100:00100000:1.0:1788684223.631841:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788684223.631847:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085791616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684223.631960:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085791872:0@lo:400:kworker.0 00000100:00100000:0.0:1788684223.631995:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684223.632045:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684223.632052:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085792000:0@lo:400:kworker.0 00000100:00100000:0.0:1788684223.632076:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788684223.632200:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647566d80 x1875571085791488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684223.632214:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085791488:0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.632292:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085791616:12345-0@lo:400:kworker.0 Request processed in 444us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684223.632298:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:1.0:1788684223.632337:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684223.632350:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085791872 00000100:00100000:1.0:1788684223.632354:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085791872 00000100:00100000:1.0:1788684223.632425:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085792000 00000100:00100000:1.0:1788684223.632429:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085792000 00000100:00100000:1.0:1788684223.632451:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788684223.632459:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085791872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.632513:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085791872:12345-0@lo:400:kworker.0 Request processed in 55us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684223.632519:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788684223.632533:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788684223.632540:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085792000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.632566:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085792000:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684223.632571:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788684223.632605:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085792000:0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.632614:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085791872:0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.632632:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085791744:0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.632659:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684223.632689:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085791744 00000100:00100000:1.0:1788684223.632693:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085791744 00000100:00100000:1.0:1788684223.632731:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788684223.632738:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664795aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085791744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684223.632774:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664795aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085791744:12345-0@lo:400:kworker.0 Request processed in 37us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684223.632781:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:1.0:1788684223.632809:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647959f80 x1875571085791744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684223.632819:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085791744:0@lo:400:kworker.0 00000100:00080000:0.0:1788684223.632956:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684223.632966:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684223.633293:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085791616:0@lo:400:kworker.0 00000100:00100000:1.0:1788684224.126469:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684224.126489:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085792128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684224.126572:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684224.126775:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684224.126790:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085792128 00000100:00100000:0.0:1788684224.126798:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085792128 00000100:00100000:0.0:1788684224.126853:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788684224.126864:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085792128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684224.126891:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684224.126935:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085792128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684224.126943:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788684224.128123:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085792256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684224.128181:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684224.128420:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085792128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684224.128723:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085792384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684224.129177:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085792256 00000100:00100000:3.0:1788684224.129185:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085792256 00000100:00100000:3.0:1788684224.129236:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788684224.129244:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085792256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684224.129275:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788684224.129342:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085792256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684224.129349:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788684224.132061:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085792256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684224.133935:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684224.134144:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085792384 00000100:00100000:2.0:1788684224.134153:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085792384 00000100:00100000:2.0:1788684224.134208:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788684224.134218:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085792384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684224.134241:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684224.134289:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085792384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684224.134296:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788684224.134400:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085792384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684224.638555:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788684224.638575:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085792512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684224.638672:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684224.638740:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085792512 00000100:00100000:2.0:1788684224.638747:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085792512 00000100:00100000:2.0:1788684224.638790:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788684224.638797:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085792512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684224.638828:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788684224.638873:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085792512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684224.638881:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788684224.638975:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085792512:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788684225.006932:0:14036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:43:43 (1788684223) 00010000:00010000:1.0:1788684225.155270:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684226.175823:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684226.567938:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684226.568016:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073120640 00000100:00100000:3.0:1788684226.568024:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073120640 00000100:00100000:3.0:1788684226.568101:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:3.0:1788684226.568112:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:11068:x1875571073120640:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684226.568141:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684226.568198:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a4c expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788684226.568220:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788684226.568259:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac60f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.568273:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac60f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.568286:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac60f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684226.568330:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788684226.568333:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684226.568401:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac60f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.568425:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a4c expref: 7 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.568442:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac60f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a4c expref: 6 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.568450:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c900) 00010000:00010000:3.0:1788684226.568453:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788684226.568456:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c600, rc 0) 00000100:00100000:3.0:1788684226.568513:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:11068:x1875571073120640:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 403us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684226.568520:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:0.0:1788684226.575884:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684226.575990:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073120768 00000100:00100000:3.0:1788684226.576001:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073120768 00000100:00100000:3.0:1788684226.576099:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:3.0:1788684226.576110:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:11069:x1875571073120768:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684226.576129:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684226.576148:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a53 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576204:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576218:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576228:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576242:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576248:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576255:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576311:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac62b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576319:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac62b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576347:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac62b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684226.576403:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788684226.576407:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684226.576435:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac62b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576446:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576452:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576460:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576465:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684226.576470:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576476:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576488:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c900) 00010000:00010000:3.0:1788684226.576491:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684226.576495:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576501:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac61d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576524:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576529:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576535:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576540:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684226.576543:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576549:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576567:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d677cc3c300) 00010000:00010000:3.0:1788684226.576569:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684226.576572:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576578:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac624 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576607:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a53 expref: 8 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576620:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac62b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a53 expref: 7 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684226.576638:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d677cc3c700) 00010000:00010000:3.0:1788684226.576640:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788684226.576643:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c800, rc 0) 00000100:00100000:3.0:1788684226.576712:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:11069:x1875571073120768:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 604us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684226.576719:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:0.0:1788684226.582493:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684226.582584:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073120896 00000100:00100000:2.0:1788684226.582593:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073120896 00000100:00100000:2.0:1788684226.582674:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1788684226.582684:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:11069:x1875571073120896:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788684226.582774:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:11069:x1875571073120896:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 Request processed in 92us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684226.582782:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:0.0:1788684226.591115:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684226.591200:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073121152 00000100:00100000:1.0:1788684226.591209:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073121152 00000100:00100000:1.0:1788684226.591276:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:1.0:1788684226.591286:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:11069:x1875571073121152:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684226.591308:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684226.591327:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac632 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a5a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591423:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591443:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591454:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591523:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591531:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591565:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591662:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac647 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591671:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac647 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591678:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac647 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684226.591687:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788684226.591790:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591798:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591805:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591811:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684226.591815:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591823:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591835:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d677cc3c700) 00010000:00010000:1.0:1788684226.591838:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684226.591848:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591855:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac639 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591868:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591875:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591880:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591885:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684226.591888:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591893:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591901:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d675677dd00) 00010000:00010000:1.0:1788684226.591903:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684226.591906:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.591912:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac640 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.592803:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac632 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a5a expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.592841:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac647 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a5a expref: 9 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684226.592849:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:1.0:1788684226.592852:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684226.592854:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0a00, rc 0) 00000100:00100000:1.0:1788684226.592927:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:11069:x1875571073121152:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1642us (1820us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788684226.592936:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:0.0:1788684226.602085:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684226.602165:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073121280 00000100:00100000:3.0:1788684226.602175:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073121280 00000100:00100000:3.0:1788684226.602229:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:3.0:1788684226.602238:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:11069:x1875571073121280:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788684226.602336:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:11069:x1875571073121280:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 99us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684226.602344:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:0.0:1788684226.605324:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684226.605448:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073121408 00000100:00100000:3.0:1788684226.605456:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073121408 00000100:00100000:3.0:1788684226.605507:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:3.0:1788684226.605517:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:11069:x1875571073121408:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788684226.606566:0:12443:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 999us 00000100:00080000:0.0:1788684226.606677:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684226.645304:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:11069:x1875571073121408:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 39780us (39979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684226.645319:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00010000:00010000:0.0:1788684227.200431:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684227.257508:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684227.257566:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684227.257588:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684227.257607:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684227.257628:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684227.257657:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073121792 00000100:00100000:0.0:1788684227.257667:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073121792 00000100:00100000:0.0:1788684227.257743:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073122048 00000100:00100000:0.0:1788684227.257746:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073122048 00000100:00100000:0.0:1788684227.257768:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073121664 00000100:00100000:0.0:1788684227.257770:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073121664 00000100:00100000:0.0:1788684227.257781:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073121920 00000100:00100000:0.0:1788684227.257783:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073121920 00000100:00100000:0.0:1788684227.257799:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 251 00000100:00100000:0.0:1788684227.257807:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073121792:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684227.257873:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073121792:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 66us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684227.257880:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 251 00000100:00100000:0.0:1788684227.257896:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 252 00000100:00100000:0.0:1788684227.257902:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073122048:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684227.257925:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073122048:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684227.257931:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 252 00000100:00100000:0.0:1788684227.257942:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:0.0:1788684227.257948:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2391:x1875571073121664:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684227.257974:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2391:x1875571073121664:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684227.257980:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:0.0:1788684227.257990:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00100000:0.0:1788684227.257996:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073121920:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684227.258016:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664787c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073121920:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 20us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684227.258031:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00080000:0.0:1788684227.258055:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684227.258059:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684227.258284:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073121536 00000100:00100000:3.0:1788684227.258289:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073121536 00000100:00100000:3.0:1788684227.258323:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 375 00000100:00100000:3.0:1788684227.258330:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073121536:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684227.258390:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6771782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073121536:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 35us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684227.258398:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 375 00000040:00080000:1.0:1788684227.517976:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788684227.518778:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788684228.226050:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684228.675526:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684228.675628:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073122176 00000100:00100000:3.0:1788684228.675638:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073122176 00000100:00100000:3.0:1788684228.675733:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:3.0:1788684228.675744:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:11112:x1875571073122176:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684228.675765:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684228.675787:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a61 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675859:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675873:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675884:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675898:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675905:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675911:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675950:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675957:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675977:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675983:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684228.675987:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.675994:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676006:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c900) 00010000:00010000:3.0:1788684228.676009:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684228.676014:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676020:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac65c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676031:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676037:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676042:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676047:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684228.676050:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676067:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676075:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d677cc3c300) 00010000:00010000:3.0:1788684228.676078:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684228.676080:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676086:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac663 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676118:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac655 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a61 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676127:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c900) 00010000:00010000:3.0:1788684228.676129:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684228.676132:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a61 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.676142:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c000, rc 0) 00000100:00100000:3.0:1788684228.676204:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:11112:x1875571073122176:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 461us (686us total) trans 0 rc 301/301 00000100:00100000:3.0:1788684228.676211:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00080000:2.0:1788684228.676334:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684228.700552:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684228.700598:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073122432 00000100:00100000:0.0:1788684228.700606:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073122432 00000100:00100000:0.0:1788684228.700669:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:0.0:1788684228.700689:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:11112:x1875571073122432:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:0.0:1788684228.700744:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684228.700772:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac60f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a4c expref: 9 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.700788:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c900) 00010000:00010000:0.0:1788684228.700798:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788684228.700856:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.700868:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.700878:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.700888:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.700895:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.700913:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701424:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701435:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701443:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788684228.701457:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d882d69 reply state 000000008f646b6a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701468:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701475:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684228.701477:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788684228.701480:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788684228.701484:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788684228.701491:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701498:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701505:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701511:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684228.701523:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701530:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701539:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6750bd9700) 00010000:00010000:0.0:1788684228.701541:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684228.701545:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701550:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac66a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788684228.701563:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d882d69 reply state 000000008f646b6a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701570:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.701575:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d6750bd9000) 00010000:00010000:0.0:1788684228.701577:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788684228.701579:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788684228.701676:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:11112:x1875571073122432:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 997us (1130us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788684228.701697:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:0.0:1788684228.736889:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085792640:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.736954:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.736994:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085793152:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.737017:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.737044:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085793664:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.737114:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.737135:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085794176:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.737157:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.737181:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788684228.737187:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085792768:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.737210:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.737227:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085793280:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.737247:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.737478:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085793792:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.737502:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.737517:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6751b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085794304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684228.739116:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684228.739185:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085792768 00000100:00100000:0.0:1788684228.739190:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085793024:0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.739196:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085792768 00000100:00100000:3.0:1788684228.739243:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085793280 00000100:00100000:3.0:1788684228.739246:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085793280 00000100:00100000:3.0:1788684228.739272:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085793792 00000100:00100000:3.0:1788684228.739275:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085793792 00000100:00100000:3.0:1788684228.739308:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788684228.739316:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085792768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.739787:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684228.739859:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085794304 00000100:00100000:2.0:1788684228.739864:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085794304 00000100:00100000:2.0:1788684228.739933:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788684228.739942:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085794304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684228.739966:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684228.742054:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085792768:12345-0@lo:400:kworker.0 Request processed in 2730us (4834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.742065:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788684228.742097:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085793024 00000100:00100000:3.0:1788684228.742104:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085793024 00000100:00100000:3.0:1788684228.743296:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788684228.743306:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085793280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.743387:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085793280:12345-0@lo:400:kworker.0 Request processed in 82us (6139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.743393:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788684228.743406:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788684228.743412:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085793792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.743437:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085793792:12345-0@lo:400:kworker.0 Request processed in 25us (5935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.743442:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788684228.743451:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788684228.743456:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085793024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.743478:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085793024:12345-0@lo:400:kworker.0 Request processed in 22us (3693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.743483:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:3.0:1788684228.743506:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684228.743511:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684228.743603:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085793024:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.743617:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085793536:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.743718:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.743748:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085794048:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.743772:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.743804:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788684228.743811:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085792896:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.743837:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.743859:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085793408:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.743898:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.743916:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085793920:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.743937:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684228.743954:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085794432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684228.743978:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085792768:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.743978:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684228.744001:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085793280:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.744021:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085792640 00000100:00100000:3.0:1788684228.744027:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085793792:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.744029:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085792640 00000100:00100000:3.0:1788684228.744062:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085793664 00000100:00100000:3.0:1788684228.744067:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085793664 00000100:00100000:0.0:1788684228.744071:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788684228.744081:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085792640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.744104:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085794176 00000100:00100000:3.0:1788684228.744109:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085794176 00000100:00100000:0.0:1788684228.744123:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d676d876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085792640:12345-0@lo:400:kworker.0 Request processed in 45us (7168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684228.744130:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788684228.744159:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085793152 00000100:00100000:0.0:1788684228.744163:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085793152 00000100:00100000:0.0:1788684228.744185:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085792896 00000100:00100000:0.0:1788684228.744188:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085792896 00000100:00100000:0.0:1788684228.744199:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788684228.744204:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085793152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.744240:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085793536 00000100:00100000:3.0:1788684228.744244:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085793536 00000100:00100000:0.0:1788684228.744246:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085793152:12345-0@lo:400:kworker.0 Request processed in 40us (7226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.744255:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085794048 00000100:00100000:3.0:1788684228.744258:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085794048 00000100:00100000:3.0:1788684228.744268:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788684228.744274:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085793664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.744306:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085793664:12345-0@lo:400:kworker.0 Request processed in 33us (7192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.744311:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788684228.744322:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788684228.744326:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085794176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.744349:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085794176:12345-0@lo:400:kworker.0 Request processed in 23us (7191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.744354:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788684228.744361:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788684228.744386:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1875571085793536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.744414:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1875571085793536:12345-0@lo:400:kworker.0 Request processed in 49us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.744419:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788684228.744428:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788684228.744433:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085794048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.744465:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085794048:12345-0@lo:400:kworker.0 Request processed in 32us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.744471:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788684228.744487:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085793408 00000100:00100000:3.0:1788684228.744490:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085793408 00000100:00100000:3.0:1788684228.744511:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085793920 00000100:00100000:3.0:1788684228.744514:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085793920 00000100:00100000:0.0:1788684228.744529:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788684228.744533:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788684228.744541:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085793408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.744552:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788684228.744560:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085792896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.744592:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085792896:12345-0@lo:400:kworker.0 Request processed in 33us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684228.744598:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788684228.746879:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085793408:12345-0@lo:400:kworker.0 Request processed in 2335us (2976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.746890:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788684228.747873:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788684228.747886:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085793920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.747954:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085793920:12345-0@lo:400:kworker.0 Request processed in 72us (4015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.747960:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788684228.747983:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788684228.747990:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:3.0:1788684228.748026:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684228.748031:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684228.748034:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684228.750441:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085792640:0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.750459:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085793152:0@lo:400:kworker.0 00010000:00080000:3.0:1788684228.750477:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f8700 x1875571085793664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684228.750499:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085793664:0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.750514:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085794176:0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.752453:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085792896:0@lo:400:kworker.0 00000100:00100000:2.0:1788684228.758199:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085794304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 18252us (19080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684228.758214:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1788684228.759048:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6751b56d80 x1875571085794304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684228.759071:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6751b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085794304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684228.759107:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085794432 00000100:00100000:2.0:1788684228.759137:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085794432 00000100:00100000:2.0:1788684228.759170:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788684228.759177:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085794432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684228.759199:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684228.759254:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085794432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (15277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684228.759260:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1788684228.759512:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f9180 x1875571085793408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684228.759525:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085793408:0@lo:400:kworker.0 00010000:00080000:3.0:1788684228.759665:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f9880 x1875571085793920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684228.759674:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085793920:0@lo:400:kworker.0 00010000:00080000:3.0:1788684228.759698:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a80700 x1875571085794432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684228.759712:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085794432:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788684228.759724:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67772f9500 x1875571085793536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684228.759732:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085793536:0@lo:400:kworker.0 00000100:00100000:3.0:1788684228.759744:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085794048:0@lo:400:kworker.0 00000100:00100000:0.0:1788684228.824165:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684228.824230:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073122560 00000100:00100000:3.0:1788684228.824240:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073122560 00000100:00100000:3.0:1788684228.824304:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:3.0:1788684228.824315:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:11120:x1875571073122560:12345-192.168.206.44@tcp:101:lctl.0 00010000:00010000:3.0:1788684228.824353:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684228.824415:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac67f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a68 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.824479:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac686 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.824493:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.824506:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684228.824556:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788684228.824560:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684228.824595:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.824617:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac67f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a68 expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.824634:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac686 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a68 expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.824642:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:3.0:1788684228.824645:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788684228.824648:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d600, rc 0) 00000100:00100000:3.0:1788684228.824711:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:11120:x1875571073122560:12345-192.168.206.44@tcp:101:lctl.0 Request processed in 397us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.824717:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:0.0:1788684228.874476:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684228.874531:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073122688 00000100:00100000:3.0:1788684228.874541:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073122688 00000100:00100000:3.0:1788684228.874603:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:3.0:1788684228.874613:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:11126:x1875571073122688:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684228.874632:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684228.874653:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac68d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a6f expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874726:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874740:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874751:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874761:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874768:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874776:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874852:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac6a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874860:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874884:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684228.874932:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788684228.874936:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684228.874975:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874987:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.874993:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875000:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875006:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684228.875010:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875018:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875030:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:3.0:1788684228.875033:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684228.875037:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875043:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875067:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875074:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875080:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875085:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684228.875088:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875094:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875102:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d6750bd9000) 00010000:00010000:3.0:1788684228.875105:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684228.875107:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875217:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac69b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875244:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac68d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a6f expref: 13 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875258:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a6f expref: 12 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.875277:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:3.0:1788684228.875280:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788684228.875282:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d200, rc 0) 00000100:00100000:3.0:1788684228.875345:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:11126:x1875571073122688:12345-192.168.206.44@tcp:101:bash.0 Request processed in 733us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.875352:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:1.0:1788684228.881092:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684228.881709:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073122944 00000100:00100000:2.0:1788684228.881721:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073122944 00000100:00100000:2.0:1788684228.881779:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:2.0:1788684228.881789:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:11126:x1875571073122944:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684228.881810:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684228.881830:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac6a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a76 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.882215:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.882232:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.882243:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.882301:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.882309:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.882334:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788684228.883017:0:6498:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788684228.883194:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883205:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883213:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883240:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883247:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883254:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883259:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684228.883264:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883271:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883281:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684228.883284:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684228.883296:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883302:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac6b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684228.883315:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f40a7327 reply state 00000000584eefa5 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883326:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883332:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6647575900) 00010000:00010000:2.0:1788684228.883334:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684228.883337:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788684228.883457:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac6a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a76 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883473:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a76 expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684228.883481:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6647575100) 00010000:00010000:2.0:1788684228.883484:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684228.883486:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4c00, rc 0) 00000100:00100000:2.0:1788684228.883554:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:11126:x1875571073122944:12345-192.168.206.44@tcp:101:bash.0 Request processed in 1767us (2471us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788684228.883563:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:0.0:1788684228.888409:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684228.888495:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073123072 00000100:00100000:3.0:1788684228.888505:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073123072 00000100:00100000:3.0:1788684228.888549:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:3.0:1788684228.888556:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875571073123072:12345-192.168.206.44@tcp:8:bash.0 00010000:00080000:3.0:1788684228.888587:0:8412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:3.0:1788684228.888614:0:8412:0:(genops.c:1385:class_connect()) connect: client 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e, cookie 0x44bac02bd54ac6cc 00002000:00100000:3.0:1788684228.888634:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e/ffff8d6647915800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788684228.888645:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788684228.888726:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788684228.888754:0:8412:0:(import.c:65:import_set_state_nolock()) ffff8d6647914000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684228.888813:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2389:x1875571073123072:12345-192.168.206.44@tcp:8:bash.0 Request processed in 256us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.888822:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:1.0:1788684228.897113:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684228.897211:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073123200 00000100:00100000:0.0:1788684228.897221:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073123200 00000100:00100000:0.0:1788684228.897300:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:0.0:1788684228.897309:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:0:x1875571073123200:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1788684228.897324:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684228.897344:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a7d expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684228.897405:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684228.897424:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1788684228.897428:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684228.897437:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a7d expref: 7 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.897456:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a7d expref: 7 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684228.897468:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891600, rc 0) 00000100:00100000:0.0:1788684228.897517:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:0:x1875571073123200:12345-192.168.206.44@tcp:101:bash.0 Request processed in 210us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684228.897524:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00080000:3.0:1788684228.897823:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684228.901143:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684228.901244:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073123328 00000100:00100000:3.0:1788684228.901267:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073123328 00000100:00100000:3.0:1788684228.901322:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:3.0:1788684228.901332:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:11126:x1875571073123328:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684228.901400:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684228.901421:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a84 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.901451:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a7d expref: 8 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.901460:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684228.901465:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684228.901470:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.901505:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a7d expref: 8 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.901519:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a7d expref: 8 pid: 8413 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684228.901532:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1875571085794560:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684228.901622:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674890b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788684228.909060:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684228.909163:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073123456 00000100:00100000:1.0:1788684228.909172:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073123456 00010000:00010000:1.0:1788684228.909210:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a7d expref: 9 pid: 8413 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684228.909254:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:1.0:1788684228.909263:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2393:x1875571073123456:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684228.909278:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684228.909297:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a7d expref: 9 pid: 8413 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684228.909329:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a7d expref: 9 pid: 8413 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684228.909356:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684228.909361:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684228.909394:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684228.909405:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684228.909453:0:6484:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684228.909467:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6484:1875571085794688:192.168.206.44@tcp:105: 00000100:00100000:1.0:1788684228.909595:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317600 going to sleep for 11 seconds 00010000:00010000:3.0:1788684228.911781:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ac6d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a7d expref: 9 pid: 8413 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684228.911807:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1875571085794560:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684228.911840:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684228.911873:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c000, rc 0) 00000100:00100000:3.0:1788684228.911947:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:11126:x1875571073123328:12345-192.168.206.44@tcp:101:bash.0 Request processed in 10616us (10813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684228.911955:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:1.0:1788684228.914938:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6484:1875571085794688:192.168.206.44@tcp:105: 00010000:00010000:1.0:1788684228.914964:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684228.915027:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073123456:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 5764us (5975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684228.915038:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:1.0:1788684228.926609:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684228.926998:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073123712 00000100:00100000:0.0:1788684228.927008:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073123712 00000100:00100000:0.0:1788684228.927069:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:0.0:1788684228.927095:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:11126:x1875571073123712:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:0.0:1788684228.927357:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:11126:x1875571073123712:12345-192.168.206.44@tcp:35:bash.0 Request processed in 264us (757us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788684228.927403:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:0.0:1788684229.047493:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.047585:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073123968 00000100:00100000:3.0:1788684229.047594:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073123968 00000100:00100000:3.0:1788684229.047660:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:3.0:1788684229.047670:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:11136:x1875571073123968:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684229.047705:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684229.047724:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac6e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a8b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684229.047808:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788684229.047909:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac6e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a8b expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.047923:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:3.0:1788684229.047927:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684229.047931:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac6e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a8b expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.047944:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711cc00, rc 0) 00000100:00100000:3.0:1788684229.048007:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:11136:x1875571073123968:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 338us (523us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788684229.048014:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:2.0:1788684229.052929:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684229.053025:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073124224 00000100:00100000:0.0:1788684229.053035:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073124224 00000100:00100000:0.0:1788684229.053092:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:0.0:1788684229.053103:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:11136:x1875571073124224:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:0.0:1788684229.053338:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:11136:x1875571073124224:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 235us (415us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788684229.053346:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:1.0:1788684229.129500:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684229.129610:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073124352 00000100:00100000:0.0:1788684229.129620:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073124352 00000100:00100000:0.0:1788684229.129723:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:0.0:1788684229.129733:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:11142:x1875571073124352:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684229.129756:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684229.129775:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54ac6ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a92 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.129835:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac6f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.129849:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.129860:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684229.129925:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788684229.129929:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684229.129947:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.129974:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54ac6ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a92 expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.129992:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a92 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.130001:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684229.130004:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684229.130007:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890c00, rc 0) 00000100:00100000:0.0:1788684229.130067:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11142:x1875571073124352:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 335us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684229.130074:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:2.0:1788684229.135032:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684229.135531:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073124608 00000100:00100000:0.0:1788684229.135607:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073124608 00000100:00100000:0.0:1788684229.135707:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:0.0:1788684229.135717:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11142:x1875571073124608:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684229.135737:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684229.135757:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac6fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3a99 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.135857:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac704 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.135881:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.135891:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684229.135915:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788684229.136022:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac6fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a99 expref: 22 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.136040:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac704 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a99 expref: 21 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.136048:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6647575100) 00010000:00010000:0.0:1788684229.136051:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684229.136054:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890800, rc 0) 00000100:00100000:0.0:1788684229.136237:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:11142:x1875571073124608:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 521us (1212us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788684229.136245:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:2.0:1788684229.139973:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.140108:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073124864 00000100:00100000:3.0:1788684229.140117:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073124864 00000100:00100000:3.0:1788684229.140168:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:3.0:1788684229.140176:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:11142:x1875571073124864:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684229.140198:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684229.140217:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac712 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3aa0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.140318:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac719 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.140333:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.140344:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684229.140355:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788684229.140486:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac712 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aa0 expref: 24 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.140504:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac719 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aa0 expref: 23 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.140512:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6647575100) 00010000:00010000:3.0:1788684229.140515:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788684229.140518:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d000, rc 0) 00000100:00100000:3.0:1788684229.140648:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:11142:x1875571073124864:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 472us (684us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788684229.140670:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:1.0:1788684229.147737:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684229.147794:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684229.147864:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073125120 00000100:00100000:0.0:1788684229.147872:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073125120 00000100:00100000:0.0:1788684229.147934:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:0.0:1788684229.147944:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2390:x1875571073125120:12345-192.168.206.44@tcp:1:lfs.0 00010000:00010000:0.0:1788684229.147988:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.148006:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.148021:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788684229.148025:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788684229.148030:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.148063:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.148077:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 7 pid: 8412 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684229.148091:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875571085794816:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684229.148181:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788684229.148329:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073124992 00000100:00100000:3.0:1788684229.148334:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073124992 00000100:00100000:3.0:1788684229.148404:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:3.0:1788684229.148412:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:2393:x1875571073124992:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684229.148421:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684229.148440:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac704 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a99 expref: 23 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.148456:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6647575100) 00010000:00010000:3.0:1788684229.148460:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684229.148486:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:2393:x1875571073124992:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 74us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684229.148493:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:1.0:1788684229.153095:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.153174:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073125248 00000100:00100000:3.0:1788684229.153182:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073125248 00002000:00100000:3.0:1788684229.153228:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8d67450b2a00 x1875571073125248/t0(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:150/0 lens 504/0 e 0 to 0 dl 1788684240 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788684229.153238:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67450b2a00 with x1875571073125248 ext(0->12) 00010000:00010000:3.0:1788684229.153248:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 8 pid: 8412 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.153264:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 8 pid: 8412 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788684229.153272:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d67450b2a00 00000100:00100000:3.0:1788684229.153320:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:3.0:1788684229.153329:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073125248:12345-192.168.206.44@tcp:4:lfs.0 00000100:00100000:0.0:1788684229.154326:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875571085794816:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684229.154352:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788684229.155928:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000100:00100000:2.0:1788684229.157276:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2392:x1875571073125248:12345-192.168.206.44@tcp:4:lfs.0 Request processed in 3940us (4181us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788684229.157293:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00002000:00100000:2.0:1788684229.157304:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8d67450b2a00 x1875571073125248/t4294967300(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:150/0 lens 504/448 e 0 to 0 dl 1788684240 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788684229.157313:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67450b2a00 with x1875571073125248 ext(0->12) 00010000:00010000:2.0:1788684229.157323:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 9 pid: 8412 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.157339:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 9 pid: 8412 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684229.157345:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d67450b2a00 00000100:00100000:2.0:1788684229.160509:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.160658:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073125376 00000100:00100000:3.0:1788684229.160667:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073125376 00010000:00010000:3.0:1788684229.160712:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 9 pid: 8412 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684229.160801:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:3.0:1788684229.160811:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2392:x1875571073125376:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684229.160825:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788684229.160843:0:6482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788684229.160846:0:6482:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788684228 00002000:00010000:3.0:1788684229.160849:0:6482:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788684229 00002000:00010000:3.0:1788684229.160851:0:6482:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788684228 00002000:00010000:3.0:1788684229.160853:0:6482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788684229.160858:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 9 pid: 8412 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.160872:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 9 pid: 8412 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.160967:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ac6da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a84 expref: 9 pid: 8412 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.160983:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684229.160987:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684229.161006:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.161015:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.161048:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684229.161149:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073125376:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 340us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684229.161157:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00010000:00010000:0.0:1788684229.161212:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.161223:0:8413:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.161251:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.161259:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.161266:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.161272:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684229.161276:0:8413:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.161285:0:8413:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.161296:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.161304:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ac727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684229.161350:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2390:x1875571073125120:12345-192.168.206.44@tcp:1:lfs.0 Request processed in 13407us (13556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684229.161358:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:0.0:1788684229.164339:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684229.164603:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073125632 00000100:00100000:1.0:1788684229.164612:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073125632 00000100:00100000:1.0:1788684229.164704:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:1.0:1788684229.164715:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11142:x1875571073125632:12345-192.168.206.44@tcp:35:lfs.0 00000004:00010000:1.0:1788684229.164775:0:6501:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac719 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aa0 expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788684229.165009:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1788684229.165055:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788684229.165700:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1788684229.165740:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.165755:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a76 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.165764:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.165797:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a76 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.165810:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a76 expref: 26 pid: 6498 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684229.165822:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1875571085794944:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684229.165911:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67561db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788684229.169005:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684229.169126:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1875571085794944:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684229.169159:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684229.170797:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073125760 00000100:00100000:2.0:1788684229.170808:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073125760 00010000:00010000:2.0:1788684229.170851:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a76 expref: 27 pid: 6498 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684229.170937:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:2.0:1788684229.170948:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:2393:x1875571073125760:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684229.170962:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684229.170969:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a76 expref: 27 pid: 6498 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.171000:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a76 expref: 27 pid: 6498 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.171022:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac6be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a76 expref: 27 pid: 6498 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.171049:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6647575100) 00010000:00010000:2.0:1788684229.171055:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.171064:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.171071:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.171100:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684229.171156:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+26:2393:x1875571073125760:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 208us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684229.171163:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00010000:00010000:1.0:1788684229.171267:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.171275:0:6501:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788684229.171420:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1788684229.171540:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1788684229.171640:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085795072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788684229.171701:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684229.171740:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cc4a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684229.171855:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085795072 00000100:00100000:3.0:1788684229.171861:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085795072 00000100:00100000:3.0:1788684229.171902:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788684229.171910:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6501:x1875571085795072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788684229.171976:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6501:x1875571085795072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 67us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684229.171983:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788684229.172320:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085795072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788684229.172491:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788684229.172547:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085795200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788684229.172578:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684229.172599:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238600 going to sleep for 11 seconds 00000100:00100000:3.0:1788684229.172705:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085795200 00000100:00100000:3.0:1788684229.172710:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085795200 00000100:00100000:3.0:1788684229.172754:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788684229.172761:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1875571085795200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788684229.172853:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6501:x1875571085795200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (273us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788684229.172859:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788684229.173176:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085795200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788684229.173211:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788684229.173254:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.173264:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.173271:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.173276:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684229.173280:0:6501:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.173299:0:6501:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.173324:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6647575100) 00010000:00010000:1.0:1788684229.173327:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788684229.173331:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.173337:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac72e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788684229.173443:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788684229.173864:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788684229.173877:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310167510342ns, next at 311167508291ns, rc = 0 00000001:00080000:1.0:1788684229.173886:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788684229.173912:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6647575100) 00010000:00010000:1.0:1788684229.173916:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788684229.173922:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac719 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aa0 expref: 30 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684229.174024:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:11142:x1875571073125632:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 9310us (9694us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788684229.174035:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000020:00080000:1.0:1788684229.174039:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788684229.177721:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.177915:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073125888 00000100:00100000:3.0:1788684229.177924:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073125888 00000100:00100000:3.0:1788684229.177979:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:3.0:1788684229.177989:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:11142:x1875571073125888:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684229.178025:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684229.178045:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac735 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3aa7 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.178098:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac735 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aa7 expref: 30 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.178112:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac735 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aa7 expref: 30 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.178130:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684229.178133:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788684229.178137:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c000, rc 0) 00000100:00100000:3.0:1788684229.179658:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:11142:x1875571073125888:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1663us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684229.179668:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:3.0:1788684229.183862:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684229.184666:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073126144 00000100:00100000:2.0:1788684229.184805:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073126144 00000100:00100000:2.0:1788684229.184908:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:2.0:1788684229.184920:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749557050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:11142:x1875571073126144:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684229.185162:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749557050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+31:11142:x1875571073126144:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 244us (1307us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788684229.185169:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00010000:00010000:3.0:1788684229.245637:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684229.245905:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684229.245925:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085795328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684229.245983:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684229.246135:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684229.246145:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085795456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684229.246174:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684229.246389:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085795328 00000100:00100000:1.0:1788684229.246396:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085795328 00000100:00100000:1.0:1788684229.246434:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085795456 00000100:00100000:1.0:1788684229.246437:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085795456 00000100:00100000:1.0:1788684229.246466:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788684229.246475:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085795328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684229.246513:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684229.246561:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085795328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684229.246568:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788684229.246608:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085795328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684229.246630:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788684229.246637:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085795456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684229.246647:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684229.246687:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085795456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684229.246694:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788684229.247130:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085795584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684229.247165:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684229.247215:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085795456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684229.247385:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085795584 00000100:00100000:1.0:1788684229.247391:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085795584 00000100:00100000:1.0:1788684229.247429:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788684229.247436:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085795584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684229.247459:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684229.247558:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085795584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684229.247563:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788684229.247634:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085795584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684229.277242:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684229.280468:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073126400 00000100:00100000:2.0:1788684229.280483:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073126400 00000100:00100000:2.0:1788684229.280553:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:2.0:1788684229.280564:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+31:11152:x1875571073126400:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684229.280588:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684229.280607:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac73c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3aae expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684229.280704:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788684229.280799:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac73c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aae expref: 33 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.280814:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:2.0:1788684229.280817:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788684229.280823:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac73c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aae expref: 33 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.280836:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4c00, rc 0) 00000100:00100000:2.0:1788684229.280954:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:11152:x1875571073126400:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 391us (3771us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788684229.280974:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:1.0:1788684229.288232:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.288334:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073126528 00000100:00100000:3.0:1788684229.288343:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073126528 00000100:00100000:3.0:1788684229.288514:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:3.0:1788684229.288526:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:11152:x1875571073126528:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:3.0:1788684229.288608:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288624:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288653:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288665:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288672:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288692:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288767:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288777:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288783:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788684229.288827:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288840:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288846:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288853:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288868:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684229.288873:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288880:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288891:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:3.0:1788684229.288895:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684229.288899:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288905:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac74a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288916:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288922:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288928:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288933:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684229.288936:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288941:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288958:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6647575900) 00010000:00010000:3.0:1788684229.288960:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684229.288963:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288970:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac751 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288979:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288992:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.288999:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.289004:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711ca00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684229.289006:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.289011:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.289017:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684229.289019:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684229.289022:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.289027:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac758 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684229.289112:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:11152:x1875571073126528:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 588us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684229.289120:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:3.0:1788684229.300248:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684229.300399:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073126784 00000100:00100000:1.0:1788684229.300409:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073126784 00000100:00100000:1.0:1788684229.300468:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:1.0:1788684229.300491:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:11152:x1875571073126784:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684229.300762:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+33:11152:x1875571073126784:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 272us (522us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788684229.300769:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:1.0:1788684229.342231:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.342350:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073127040 00000100:00100000:3.0:1788684229.342359:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073127040 00000100:00100000:3.0:1788684229.342436:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1788684229.342446:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+33:11155:x1875571073127040:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684229.342467:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684229.342485:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac75f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ab5 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342554:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342568:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342578:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342589:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342597:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342603:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342741:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342751:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342757:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684229.342766:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788684229.342840:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342847:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342854:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342860:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684229.342864:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342872:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342884:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:3.0:1788684229.342900:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684229.342908:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342925:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac766 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342939:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342945:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342950:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342954:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684229.342957:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.342962:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.343187:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6647575900) 00010000:00010000:3.0:1788684229.343190:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684229.343194:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.343200:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac76d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.343238:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac75f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ab5 expref: 36 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.343252:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ab5 expref: 35 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.343267:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684229.343269:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684229.343272:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711de00, rc 0) 00000100:00100000:3.0:1788684229.343338:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:11155:x1875571073127040:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 892us (1114us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788684229.343345:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1788684229.346996:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684229.347141:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073127168 00000100:00100000:0.0:1788684229.347150:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073127168 00000100:00100000:0.0:1788684229.347216:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:0.0:1788684229.347226:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:11155:x1875571073127168:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:0.0:1788684229.347285:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.347301:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.347310:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.347343:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.347349:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.347355:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.347360:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684229.347415:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.347425:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.347437:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684229.347440:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788684229.347443:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.347449:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac782 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684229.347508:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:11155:x1875571073127168:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 283us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684229.347515:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:0.0:1788684229.350111:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684229.350192:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073127424 00000100:00100000:1.0:1788684229.350200:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073127424 00000100:00100000:1.0:1788684229.350252:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:1.0:1788684229.350262:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:11155:x1875571073127424:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684229.350490:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+36:11155:x1875571073127424:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 229us (385us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788684229.350498:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:1.0:1788684229.621570:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684229.622153:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073127680 00000100:00100000:0.0:1788684229.622163:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073127680 00000100:00100000:0.0:1788684229.622289:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:0.0:1788684229.622301:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+36:11186:x1875571073127680:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:0.0:1788684229.622324:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684229.622342:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac789 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3abc expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.622608:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.622695:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.622720:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684229.622731:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788684229.622855:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ac789 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3abc expref: 39 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.622872:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3abc expref: 38 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.622882:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684229.622885:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684229.623029:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891a00, rc 0) 00000100:00100000:0.0:1788684229.623097:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:11186:x1875571073127680:12345-192.168.206.44@tcp:101:cat.0 Request processed in 799us (1537us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788684229.623105:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1788684229.628038:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684229.628602:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073127936 00000100:00100000:1.0:1788684229.628612:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073127936 00000100:00100000:1.0:1788684229.629002:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:1.0:1788684229.629014:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:11186:x1875571073127936:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:1.0:1788684229.629491:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:11186:x1875571073127936:12345-192.168.206.44@tcp:35:cat.0 Request processed in 478us (1460us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788684229.629500:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:3.0:1788684229.630401:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684229.630452:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073128064 00000100:00100000:1.0:1788684229.630458:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073128064 00000100:00100000:1.0:1788684229.630507:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:1.0:1788684229.630515:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:2393:x1875571073128064:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684229.630526:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684229.630571:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3abc expref: 39 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684229.630722:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:1.0:1788684229.630728:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684229.630756:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:2393:x1875571073128064:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 242us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684229.630764:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:3.0:1788684229.678559:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684229.678710:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073128320 00000100:00100000:0.0:1788684229.678719:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073128320 00000100:00100000:0.0:1788684229.678778:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:0.0:1788684229.678788:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:11192:x1875571073128320:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:0.0:1788684229.678812:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684229.678816:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788684229.678840:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac6f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a92 expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.678860:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684229.678877:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788684229.678904:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac79e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.679001:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.679015:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ab5 expref: 38 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.679024:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.679054:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ab5 expref: 38 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.679068:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ab5 expref: 38 pid: 7963 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684229.679082:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085795712:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684229.679722:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788684229.682802:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684229.682987:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085795712:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684229.683015:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684229.683310:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073128448 00000100:00100000:2.0:1788684229.683319:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073128448 00010000:00010000:2.0:1788684229.683356:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ab5 expref: 39 pid: 7963 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684229.683639:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:2.0:1788684229.683651:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:2392:x1875571073128448:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684229.683666:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684229.683692:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ab5 expref: 39 pid: 7963 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.683704:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ab5 expref: 39 pid: 7963 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.683729:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac774 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ab5 expref: 39 pid: 7963 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.683744:0:9510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684229.683760:0:9510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.683770:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.683778:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.683828:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684229.683909:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:2392:x1875571073128448:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 260us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684229.683917:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00010000:00010000:0.0:1788684229.683965:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.683973:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684229.683995:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788684229.684150:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac79e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ac3 expref: 39 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.684165:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ac3 expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684229.684172:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684229.684175:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788684229.684177:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890400, rc 0) 00000100:00100000:0.0:1788684229.684201:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:11192:x1875571073128320:12345-192.168.206.44@tcp:101:dd.0 Request processed in 5415us (5663us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788684229.684208:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:1.0:1788684229.687528:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684229.687659:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073128576 00000100:00100000:2.0:1788684229.687668:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073128576 00000100:00100000:2.0:1788684229.687800:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:2.0:1788684229.687810:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:11192:x1875571073128576:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:2.0:1788684229.687835:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684229.687855:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3aca expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.687981:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.687997:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.688008:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.688188:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aca expref: 40 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.688205:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aca expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.688214:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684229.688224:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788684229.688228:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4400, rc 0) 00000100:00100000:2.0:1788684229.688999:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:11192:x1875571073128576:12345-192.168.206.44@tcp:101:dd.0 Request processed in 1187us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684229.689007:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:1.0:1788684229.692256:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.692488:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073128832 00000100:00100000:3.0:1788684229.692519:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073128832 00000100:00100000:3.0:1788684229.692586:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:3.0:1788684229.692597:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:11192:x1875571073128832:12345-192.168.206.44@tcp:36:dd.0 00010000:00010000:3.0:1788684229.692812:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.692829:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.692840:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788684229.692963:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788684229.692988:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007915f6d6 reply state 000000006ac04b92 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.693019:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.693026:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684229.693029:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788684229.693032:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788684229.693315:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+42:11192:x1875571073128832:12345-192.168.206.44@tcp:36:dd.0 Request processed in 719us (1066us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788684229.693323:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00000020:00080000:3.0:1788684229.693328:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788684229.757935:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085795840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684229.758003:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684229.758134:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085795840 00000100:00100000:3.0:1788684229.758143:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085795840 00000100:00100000:3.0:1788684229.758195:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788684229.758204:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085795840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684229.758237:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1788684229.767103:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085795840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8891us (9091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684229.767125:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788684229.768681:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085795840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684229.966330:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.966576:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073128960 00000100:00100000:3.0:1788684229.966592:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073128960 00000100:00100000:3.0:1788684229.966696:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:3.0:1788684229.966709:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+42:11206:x1875571073128960:12345-192.168.206.44@tcp:101:stat.0 00010000:00010000:3.0:1788684229.966742:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684229.966779:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac7c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ad1 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.967067:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.967092:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.967106:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.967942:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.967955:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.967966:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.968061:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.968075:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ac3 expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.968084:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.968353:0:7963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ac3 expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.968393:0:7963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ac3 expref: 43 pid: 6497 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684229.968496:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085795968:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684229.968801:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674306bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684229.978816:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684229.980073:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085795968:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684229.980102:0:7963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684229.983870:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073129216 00000100:00100000:2.0:1788684229.983887:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073129216 00000100:00100000:2.0:1788684229.983964:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:2.0:1788684229.983974:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:6158:x1875571073129216:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788684229.984312:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+45:6158:x1875571073129216:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 337us (5501us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788684229.984320:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:1.0:1788684229.987854:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684229.987960:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073129344 00000100:00100000:2.0:1788684229.987970:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073129344 00010000:00010000:2.0:1788684229.988009:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ac3 expref: 45 pid: 6497 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684229.988049:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:2.0:1788684229.988059:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+45:2392:x1875571073129344:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684229.988073:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684229.988079:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ac3 expref: 45 pid: 6497 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.988093:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ac3 expref: 45 pid: 6497 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.988236:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac7a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ac3 expref: 45 pid: 6497 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.988268:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684229.988273:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.988282:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.988290:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684229.988322:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684229.988421:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:2392:x1875571073129344:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 363us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684229.988428:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00010000:00010000:3.0:1788684229.988718:0:7963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988727:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684229.988779:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788684229.988783:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684229.988821:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988834:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988843:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988850:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988856:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988862:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684229.988873:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988881:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988892:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:3.0:1788684229.988895:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684229.988899:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988906:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988916:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988922:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988927:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.988931:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711de00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684229.988934:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.989194:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.989204:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6647575900) 00010000:00010000:3.0:1788684229.989207:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684229.989216:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.989223:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.989255:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac7c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad1 expref: 44 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.989268:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad1 expref: 43 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684229.989274:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684229.989277:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684229.989279:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d000, rc 0) 00000100:00100000:3.0:1788684229.989311:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:11206:x1875571073128960:12345-192.168.206.44@tcp:101:stat.0 Request processed in 22605us (22990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684229.989319:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:0.0:1788684230.085882:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684230.085976:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073129600 00000100:00100000:2.0:1788684230.085988:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073129600 00000100:00100000:2.0:1788684230.086058:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:2.0:1788684230.086068:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:11212:x1875571073129600:12345-192.168.206.44@tcp:36:truncate.0 00010000:00010000:2.0:1788684230.086130:0:12443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684230.086160:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ac7dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad1 expref: 43 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.086191:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684230.086197:0:12443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684230.086415:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.086432:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.086458:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684230.086511:0:12443:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788684230.086538:0:12443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d78d2b86 reply state 0000000071209391 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.086551:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.086558:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684230.086561:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684230.086563:0:12443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684230.086662:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+45:11212:x1875571073129600:12345-192.168.206.44@tcp:36:truncate.0 Request processed in 596us (790us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788684230.086681:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00000020:00080000:2.0:1788684230.086686:0:12443:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1788684230.087216:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684230.222985:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684230.223144:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073129728 00000100:00100000:3.0:1788684230.223154:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073129728 00000100:00100000:3.0:1788684230.223216:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:3.0:1788684230.223226:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+45:11226:x1875571073129728:12345-192.168.206.44@tcp:101:stat.0 00010000:00010000:3.0:1788684230.223248:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684230.223269:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac7eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ad8 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223334:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223398:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223410:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223424:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223432:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223439:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223505:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223515:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223522:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684230.223563:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788684230.223567:0:13784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684230.223586:0:13784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223598:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223617:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223623:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223630:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223636:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711de00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684230.223640:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223648:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223659:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:3.0:1788684230.223662:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684230.223667:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223687:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac7f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223700:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223707:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223712:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223727:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684230.223730:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223736:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223746:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6647575900) 00010000:00010000:3.0:1788684230.223748:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684230.223751:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223757:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac7f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223784:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac7eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad8 expref: 47 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223798:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad8 expref: 46 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.223806:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684230.223808:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684230.223811:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c600, rc 0) 00000100:00100000:3.0:1788684230.223882:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+46:11226:x1875571073129728:12345-192.168.206.44@tcp:101:stat.0 Request processed in 657us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684230.223890:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00010000:00010000:1.0:1788684230.269868:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684230.306332:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684230.306511:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073129984 00000100:00100000:0.0:1788684230.306526:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073129984 00000100:00100000:0.0:1788684230.306725:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:0.0:1788684230.306738:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+46:11236:x1875571073129984:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684230.306767:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684230.306795:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac807 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684230.306995:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788684230.307142:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac807 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3adf expref: 48 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.307159:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:0.0:1788684230.307163:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788684230.307170:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac807 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3adf expref: 48 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.307186:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891200, rc 0) 00000100:00100000:0.0:1788684230.307269:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+47:11236:x1875571073129984:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 534us (952us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788684230.307277:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:1.0:1788684230.311131:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684230.311239:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073130240 00000100:00100000:2.0:1788684230.311254:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073130240 00000100:00100000:2.0:1788684230.311436:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:2.0:1788684230.311449:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+47:11236:x1875571073130240:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684230.311696:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+48:11236:x1875571073130240:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 249us (578us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788684230.311704:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:2.0:1788684230.378976:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684230.379081:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073130496 00000100:00100000:0.0:1788684230.379096:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073130496 00000100:00100000:0.0:1788684230.379185:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:0.0:1788684230.379198:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+48:11242:x1875571073130496:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1788684230.379230:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684230.379257:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac815 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ae6 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.379432:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.379449:0:12443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad8 expref: 49 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.379459:0:12443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.379519:0:12443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad8 expref: 49 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.379545:0:12443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad8 expref: 49 pid: 13784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684230.379562:0:12443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12443:1875571085796096:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684230.379829:0:12443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684230.387819:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684230.387944:0:12443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12443:1875571085796096:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684230.387981:0:12443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684230.388092:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073130624 00000100:00100000:3.0:1788684230.388115:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073130624 00010000:00010000:3.0:1788684230.388160:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad8 expref: 50 pid: 13784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684230.388204:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1788684230.388215:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+50:2392:x1875571073130624:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684230.388232:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684230.388240:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad8 expref: 50 pid: 13784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.388253:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad8 expref: 50 pid: 13784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.388279:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ad8 expref: 50 pid: 13784 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.388297:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684230.388303:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.388314:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.388323:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.388350:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684230.388457:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+49:2392:x1875571073130624:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 244us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684230.388473:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00010000:00010000:0.0:1788684230.389196:0:12443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.389207:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684230.389231:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788684230.389439:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac815 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ae6 expref: 50 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.389459:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ae6 expref: 49 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.389468:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684230.389471:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788684230.389485:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890e00, rc 0) 00000100:00100000:0.0:1788684230.390439:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+49:11242:x1875571073130496:12345-192.168.206.44@tcp:101:bash.0 Request processed in 11234us (11460us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788684230.390453:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1788684230.394758:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684230.394853:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073130880 00000100:00100000:3.0:1788684230.394865:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073130880 00000100:00100000:3.0:1788684230.394937:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:3.0:1788684230.394947:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+49:11242:x1875571073130880:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:3.0:1788684230.395226:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.395247:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.395259:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788684230.395303:0:13784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788684230.395322:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e417b257 reply state 00000000de166539 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.395336:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.395343:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684230.395346:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788684230.395350:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684230.395797:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:11242:x1875571073130880:12345-192.168.206.44@tcp:36:bash.0 Request processed in 847us (1052us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788684230.395806:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00000020:00080000:2.0:1788684230.395828:0:13784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788684230.404928:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684230.405138:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073131008 00000100:00100000:3.0:1788684230.405151:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073131008 00000100:00100000:3.0:1788684230.405224:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:3.0:1788684230.405237:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:11242:x1875571073131008:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684230.405267:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684230.405308:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac831 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3aed expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.405471:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.405490:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ae6 expref: 53 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.405501:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.405559:0:7963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ae6 expref: 53 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.405574:0:7963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ae6 expref: 53 pid: 12443 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684230.405590:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085796224:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684230.406274:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6747ec13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684230.408561:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085796224:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684230.408602:0:7963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684230.409021:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684230.409102:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073131136 00000100:00100000:0.0:1788684230.409112:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073131136 00010000:00010000:0.0:1788684230.409160:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ae6 expref: 54 pid: 12443 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684230.409206:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:0.0:1788684230.409217:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:2392:x1875571073131136:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684230.409236:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684230.409245:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ae6 expref: 54 pid: 12443 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.409259:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ae6 expref: 54 pid: 12443 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.409286:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac81c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ae6 expref: 54 pid: 12443 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.409306:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684230.409311:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.409322:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.409331:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.409430:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684230.409491:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+53:2392:x1875571073131136:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 275us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684230.409499:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00010000:00010000:3.0:1788684230.410156:0:7963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.410169:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684230.410240:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788684230.410246:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684230.410270:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.410309:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac831 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aed expref: 53 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.410340:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aed expref: 52 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684230.410350:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684230.410353:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684230.410356:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711cc00, rc 0) 00000100:00100000:3.0:1788684230.410450:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:11242:x1875571073131008:12345-192.168.206.44@tcp:101:bash.0 Request processed in 5216us (5536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684230.410459:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:1.0:1788684230.412267:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684230.412357:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073131392 00000100:00100000:3.0:1788684230.412395:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073131392 00000100:00100000:3.0:1788684230.412460:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:3.0:1788684230.412472:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749555c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:11242:x1875571073131392:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:3.0:1788684230.413016:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749555c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+53:11242:x1875571073131392:12345-192.168.206.44@tcp:35:bash.0 Request processed in 545us (761us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788684230.413025:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:0.0:1788684230.514707:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684230.514861:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073131648 00000100:00100000:2.0:1788684230.514875:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073131648 00000100:00100000:2.0:1788684230.514955:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:2.0:1788684230.514968:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+53:11252:x1875571073131648:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684230.514998:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684230.515025:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac83f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3af4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684230.515150:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788684230.515276:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac83f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3af4 expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.515293:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:2.0:1788684230.515296:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788684230.515302:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac83f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3af4 expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.515317:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5e00, rc 0) 00000100:00100000:2.0:1788684230.515450:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:11252:x1875571073131648:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 485us (756us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788684230.515457:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:1.0:1788684230.521591:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684230.521753:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073131776 00000100:00100000:0.0:1788684230.521766:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073131776 00000100:00100000:0.0:1788684230.521850:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:0.0:1788684230.521864:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:11252:x1875571073131776:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:0.0:1788684230.521976:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.521997:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522009:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522021:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522027:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522032:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522119:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522148:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522154:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788684230.522210:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522224:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522231:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522240:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522244:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684230.522248:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522255:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522267:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684230.522270:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684230.522274:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522280:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac84d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522299:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522304:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522309:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522312:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684230.522315:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522321:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522328:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6647575900) 00010000:00010000:0.0:1788684230.522330:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684230.522333:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522338:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac854 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522346:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522351:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522357:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522425:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684230.522429:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522435:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522445:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684230.522447:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684230.522451:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.522457:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac85b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684230.522859:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:11252:x1875571073131776:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 992us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684230.522870:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:3.0:1788684230.529415:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684230.529603:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073132032 00000100:00100000:2.0:1788684230.529634:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073132032 00000100:00100000:2.0:1788684230.529714:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:2.0:1788684230.529727:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:11252:x1875571073132032:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684230.530094:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+55:11252:x1875571073132032:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 368us (736us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788684230.530102:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:2.0:1788684230.565246:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684230.565495:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073132288 00000100:00100000:0.0:1788684230.565509:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073132288 00000100:00100000:0.0:1788684230.565599:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:0.0:1788684230.565612:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+55:11255:x1875571073132288:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684230.565645:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684230.565684:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac862 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3afb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.565784:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.565823:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.565835:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.565849:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.565857:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.565863:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566007:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac877 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566017:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566024:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684230.566035:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788684230.566131:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566139:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566146:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566158:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684230.566163:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566171:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566185:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684230.566188:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684230.566193:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566199:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac869 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566214:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566220:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566225:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566230:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684230.566233:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566239:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566257:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6647575900) 00010000:00010000:0.0:1788684230.566260:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684230.566263:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566268:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ac870 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566310:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac862 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3afb expref: 58 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566324:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac877 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3afb expref: 57 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.566332:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684230.566334:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684230.566337:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891600, rc 0) 00000100:00100000:0.0:1788684230.566500:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:11255:x1875571073132288:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 890us (1266us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788684230.566509:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:1.0:1788684230.572509:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684230.572865:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073132416 00000100:00100000:2.0:1788684230.572879:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073132416 00000100:00100000:2.0:1788684230.572968:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:2.0:1788684230.572980:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:11255:x1875571073132416:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:2.0:1788684230.573072:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.573094:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.573109:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.573172:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.573181:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.573189:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.573197:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684230.573217:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.573228:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.573243:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684230.573247:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788684230.573252:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.573259:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac885 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684230.573452:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:11255:x1875571073132416:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 473us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684230.573461:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:3.0:1788684230.577664:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684230.577899:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073132544 00000100:00100000:0.0:1788684230.577911:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073132544 00000100:00100000:0.0:1788684230.577982:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:0.0:1788684230.577993:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:2393:x1875571073132544:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684230.578012:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684230.578043:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac877 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3afb expref: 57 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.578092:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684230.578098:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684230.578175:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+56:2393:x1875571073132544:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 184us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684230.578183:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:2.0:1788684230.581195:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684230.581278:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073132800 00000100:00100000:1.0:1788684230.581290:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073132800 00000100:00100000:1.0:1788684230.581355:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684230.581412:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+56:11255:x1875571073132800:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684230.581703:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:11255:x1875571073132800:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 293us (519us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788684230.581711:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000040:00080000:0.0:1788684230.591792:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788684230.592771:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788684230.720017:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684230.720315:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073133056 00000100:00100000:2.0:1788684230.720329:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073133056 00000100:00100000:2.0:1788684230.720434:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00100000:2.0:1788684230.720446:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:11273:x1875571073133056:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:2.0:1788684230.720479:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684230.720505:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac88c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b02 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.720654:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac893 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.720681:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac893 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.720705:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac893 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684230.720721:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788684230.720858:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ac88c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b02 expref: 60 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.720878:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac893 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b02 expref: 59 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.720901:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684230.720905:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788684230.720909:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5400, rc 0) 00000100:00100000:2.0:1788684230.721132:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:11273:x1875571073133056:12345-192.168.206.44@tcp:101:cat.0 Request processed in 686us (1126us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788684230.721141:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00100000:2.0:1788684230.739992:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684230.740104:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073133184 00000100:00100000:0.0:1788684230.740129:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073133184 00000100:00100000:0.0:1788684230.740204:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 75 00000100:00100000:0.0:1788684230.740216:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:11274:x1875571073133184:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684230.740250:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684230.740277:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac8a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b09 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.740412:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac8a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.740430:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.740444:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684230.740498:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788684230.740502:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684230.740524:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.740594:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac8a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b09 expref: 61 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.740616:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b09 expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.740626:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684230.740629:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684230.740633:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890c00, rc 0) 00000100:00100000:0.0:1788684230.740720:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:11274:x1875571073133184:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 506us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684230.740729:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 75 00000100:00100000:3.0:1788684230.746046:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684230.746152:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073133568 00000100:00100000:1.0:1788684230.746163:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073133568 00000100:00100000:1.0:1788684230.746224:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:1.0:1788684230.746235:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:11274:x1875571073133568:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684230.746599:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:11274:x1875571073133568:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 364us (564us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788684230.746607:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:1.0:1788684230.749010:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684230.749452:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073133696 00000100:00100000:0.0:1788684230.749464:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073133696 00000100:00100000:0.0:1788684230.749602:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:0.0:1788684230.749615:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:11274:x1875571073133696:12345-192.168.206.44@tcp:103:lfs.0 00010000:00010000:0.0:1788684230.749634:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788684230.749664:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aed expref: 61 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.749703:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ac893 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b02 expref: 60 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.749717:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac735 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aa7 expref: 59 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684230.749753:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684230.749758:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684230.750071:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:11274:x1875571073133696:12345-192.168.206.44@tcp:103:lfs.0 Request processed in 457us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684230.750080:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:3.0:1788684230.751973:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684230.752088:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073133824 00000100:00100000:1.0:1788684230.752099:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073133824 00000100:00100000:1.0:1788684230.752178:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:1.0:1788684230.752190:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:11274:x1875571073133824:12345-192.168.206.44@tcp:58:lfs.0 00010000:00010000:1.0:1788684230.752359:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684230.752411:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684230.752425:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788684230.753011:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684230.753282:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788684230.753515:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788684230.753812:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:11274:x1875571073133824:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 1619us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684230.753824:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:3.0:1788684230.774317:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684230.774522:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073133952 00000100:00100000:2.0:1788684230.774545:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073133952 00000100:00100000:2.0:1788684230.774623:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:2.0:1788684230.774634:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:11276:x1875571073133952:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684230.774660:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684230.774697:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac8b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b10 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.774775:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.774812:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.774824:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.774838:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.774846:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.774853:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.774954:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.774964:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.774972:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684230.775022:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788684230.775028:0:13784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684230.775049:0:13784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775062:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775082:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775089:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775097:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775103:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684230.775108:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775246:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775261:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684230.775263:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684230.775269:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775275:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ac8bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775290:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775296:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775302:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775313:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684230.775317:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775322:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775330:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6647575900) 00010000:00010000:2.0:1788684230.775332:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684230.775335:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775340:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac8c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775585:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac8b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b10 expref: 60 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775603:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b10 expref: 59 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684230.775611:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684230.775613:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684230.775616:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4200, rc 0) 00000100:00100000:2.0:1788684230.775706:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:11276:x1875571073133952:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1073us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684230.775714:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 77 00010000:00010000:1.0:1788684231.296576:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788684231.613595:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788684231.613603:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788684231.613636:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788684231.613644:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788684231.613781:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085796352:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788684231.613875:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664186b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684231.625322:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.625795:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073134080 00000100:00100000:0.0:1788684231.625804:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073134080 00000100:00100000:0.0:1788684231.625849:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:0.0:1788684231.625859:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:11287:x1875571073134080:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788684231.625890:0:6497:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788684231.626000:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:11287:x1875571073134080:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 142us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684231.626007:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:3.0:1788684231.626189:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085796352:192.168.206.44@tcp:107:hsm_cdtr.0 00000001:00080000:2.0:1788684231.631754:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1788684231.631836:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788684231.631856:0:6476:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d677e238c00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788684231.631860:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d677e3fe500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d677e2380c0 00000020:00080000:2.0:1788684231.631863:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d677e3fe400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d66459ca200 00010000:00010000:1.0:1788684231.632265:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788684231.632714:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788684231.632869:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788684231.632888:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085796480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788684231.632949:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684231.633138:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633147:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633236:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684231.633242:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633251:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633267:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d6750bd9000) 00010000:00010000:1.0:1788684231.633484:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684231.633491:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633499:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac671 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633604:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633612:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633618:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633624:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684231.633627:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633634:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633643:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:1.0:1788684231.633645:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684231.633648:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633654:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ac678 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633681:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633687:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633693:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633703:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684231.633707:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633713:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633721:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6647575900) 00010000:00010000:1.0:1788684231.633724:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684231.633727:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633732:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac6b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633748:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633754:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633760:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633765:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711ca00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684231.633767:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633773:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633788:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:1.0:1788684231.633790:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684231.633793:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633798:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ac7c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633808:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633813:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633819:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633824:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684231.633827:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633832:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633839:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:1.0:1788684231.633841:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684231.633843:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633849:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ac7e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633869:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633875:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633881:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633885:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684231.633888:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633895:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633902:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:1.0:1788684231.633904:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684231.633906:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.633912:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ac82a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684231.635736:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085796480 00000100:00100000:0.0:1788684231.635749:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085796480 00000100:00100000:0.0:1788684231.635823:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684231.635834:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085796480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788684231.635863:0:8411:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788684231.635895:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9d27c4, atime: 0x6a9d27c5, ctime: 0x6a9d27c4, blocks: 0x8 00010000:00010000:0.0:1788684231.635902:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.635930:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:0.0:1788684231.635935:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684231.635941:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.635957:0:8411:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.635967:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.635975:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.635994:0:8411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788684231.636095:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788684231.636135:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684231.636141:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.636149:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684231.636153:0:9499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.636162:0:9499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.636178:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.636186:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ac8d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.636216:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684231.636217:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684231.636219:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684231.640596:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684231.641992:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073134208 00000100:00100000:3.0:1788684231.642004:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073134208 00000100:00100000:3.0:1788684231.642059:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:3.0:1788684231.642068:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:11287:x1875571073134208:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788684231.642139:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.642156:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.642168:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.642303:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.642312:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.642319:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.642347:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.642356:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.642362:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684231.642481:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085796480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6647us (9529us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788684231.642491:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:0.0:1788684231.642612:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d677fa6aa00/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788684231.642619:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085796480:0@lo:6:osp-syn-0-0.0 00000004:00200000:3.0:1788684231.643133:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788684231.643138:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684231.643152:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643164:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643178:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643185:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643190:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684231.643194:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643200:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643287:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:3.0:1788684231.643291:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684231.643296:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643302:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ac8d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643313:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643319:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643325:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643331:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711de00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684231.643340:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643346:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643354:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8d677cc3cb00) 00010000:00010000:3.0:1788684231.643356:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684231.643358:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643378:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac8e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643394:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643400:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643406:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643411:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684231.643414:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643419:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643425:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684231.643428:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684231.643437:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.643443:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac8e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.643517:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:11287:x1875571073134208:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 1448us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684231.643525:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 79 00000040:00080000:2.0:1788684231.645676:0:14185:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788684231.645685:0:14185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684231.645851:0:14185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788684231.645859:0:14185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684231.651239:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684231.651687:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073134464 00000100:00100000:1.0:1788684231.651696:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073134464 00000100:00100000:1.0:1788684231.651755:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:1.0:1788684231.651766:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:11287:x1875571073134464:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684231.651794:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684231.651815:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac8ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b17 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.651923:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.651938:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.651949:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684231.651961:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788684231.652043:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.652050:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.652057:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.652062:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684231.652066:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.652073:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.652085:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:1.0:1788684231.652093:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788684231.652099:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.652104:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac8f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.652145:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac8ee lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b17 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.653780:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:1.0:1788684231.653786:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684231.653794:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac8ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b17 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.653809:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0200, rc 0) 00000100:00100000:1.0:1788684231.653874:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:11287:x1875571073134464:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 2111us (2723us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788684231.653883:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:2.0:1788684231.659915:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684231.660002:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073134592 00000100:00100000:1.0:1788684231.660012:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073134592 00000100:00100000:1.0:1788684231.660068:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:1.0:1788684231.660078:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:11287:x1875571073134592:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788684231.660111:0:6497:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788684231.660233:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:11287:x1875571073134592:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 156us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684231.660241:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:2.0:1788684231.673966:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.674007:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073134848 00000100:00100000:2.0:1788684231.674020:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073134848 00000100:00100000:2.0:1788684231.674089:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:2.0:1788684231.674106:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:11287:x1875571073134848:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684231.674134:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684231.674137:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788684231.674172:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ac8a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b09 expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.674193:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684231.674199:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684231.674215:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54ac903 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b1e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788684231.675145:0:6498:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788684231.675335:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac90a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.675353:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac90a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.675426:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac90a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.675505:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54ac903 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b1e expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.675524:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac90a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b1e expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.675548:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6647575800) 00010000:00010000:2.0:1788684231.675551:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684231.676202:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5000, rc 0) 00000100:00100000:2.0:1788684231.676302:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:11287:x1875571073134848:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 2201us (2349us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788684231.676313:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:1.0:1788684231.685952:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.686042:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073135104 00000100:00100000:2.0:1788684231.686053:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073135104 00000100:00100000:2.0:1788684231.686104:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00100000:2.0:1788684231.686114:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:11287:x1875571073135104:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788684231.686173:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684231.686200:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ac90a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b1e expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686217:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6647575800) 00010000:00010000:2.0:1788684231.686226:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684231.686249:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686270:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686281:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686339:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686347:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686354:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686432:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686439:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686446:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686452:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684231.686455:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686462:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686471:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684231.686482:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684231.686486:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686491:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ac918 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686500:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686505:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686509:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686591:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684231.686594:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686599:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686609:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa3bcff57 (ffff8d6647575d00) 00010000:00010000:2.0:1788684231.686611:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684231.686614:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.686619:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ac91f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa3bcff57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684231.686717:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:11287:x1875571073135104:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 604us (772us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788684231.686730:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00100000:3.0:1788684231.690583:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.690717:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073135232 00000100:00100000:0.0:1788684231.690726:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073135232 00000100:00100000:0.0:1788684231.690782:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 84 00000100:00100000:0.0:1788684231.690802:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:11287:x1875571073135232:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684231.690821:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684231.690841:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54ac926 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.690875:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.690887:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.690898:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.690994:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54ac926 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b25 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.691009:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b25 expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.691017:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:0.0:1788684231.691020:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788684231.691023:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890800, rc 0) 00000100:00100000:0.0:1788684231.691075:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:11287:x1875571073135232:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 276us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684231.691082:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 84 00000100:00100000:3.0:1788684231.698352:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.698746:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073135488 00000100:00100000:0.0:1788684231.698755:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073135488 00000100:00100000:0.0:1788684231.698801:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 85 00000100:00100000:0.0:1788684231.698822:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:11287:x1875571073135488:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788684231.698897:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.698913:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.698924:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684231.699079:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788684231.699088:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312692720995ns, next at 313692718541ns, rc = 0 00000004:00010000:0.0:1788684231.699134:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007079e83d reply state 00000000527aa70d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.699147:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.699154:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:0.0:1788684231.699157:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788684231.699160:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788684231.699255:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:11287:x1875571073135488:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 435us (911us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788684231.699261:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 85 00000100:00100000:0.0:1788684231.700888:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684231.701047:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073135616 00000100:00100000:1.0:1788684231.701054:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073135616 00000100:00100000:1.0:1788684231.701100:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:1.0:1788684231.701109:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:11287:x1875571073135616:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684231.701129:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684231.701145:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b2c expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.701193:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b2c expref: 17 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.701204:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b2c expref: 17 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.701221:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:1.0:1788684231.701224:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684231.701227:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1200, rc 0) 00000100:00100000:1.0:1788684231.701278:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:11287:x1875571073135616:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 170us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684231.701285:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:1.0:1788684231.705127:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.707060:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073135744 00000100:00100000:0.0:1788684231.707072:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073135744 00000100:00100000:0.0:1788684231.707123:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:0.0:1788684231.707131:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875571073135744:12345-192.168.206.44@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788684231.707162:0:9991:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:0.0:1788684231.707196:0:9991:0:(genops.c:1385:class_connect()) connect: client 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e, cookie 0x44bac02bd54ac942 00002000:00100000:0.0:1788684231.707208:0:9991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e/ffff8d677fbf8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788684231.707224:0:9991:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788684231.707291:0:9991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788684231.707320:0:9991:0:(import.c:65:import_set_state_nolock()) ffff8d677fbfe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684231.707402:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2389:x1875571073135744:12345-192.168.206.44@tcp:8:lhsmtool_posix.0 Request processed in 270us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684231.707410:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:3.0:1788684231.713234:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.713318:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073135872 00000100:00100000:0.0:1788684231.713328:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073135872 00000100:00100000:0.0:1788684231.713413:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:0.0:1788684231.713423:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:0:x1875571073135872:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788684231.713686:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788684231.716248:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1788684231.716260:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000100:00100000:0.0:1788684231.716491:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:0:x1875571073135872:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 3065us (3260us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788684231.716502:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:0.0:1788684231.731023:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.731461:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073136128 00000100:00100000:2.0:1788684231.731472:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073136128 00000100:00100000:2.0:1788684231.732634:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1788684231.732648:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:11287:x1875571073136128:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788684231.732858:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:11287:x1875571073136128:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 214us (1843us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788684231.732867:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1788684231.735799:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.735839:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073136384 00000100:00100000:0.0:1788684231.735849:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073136384 00000100:00100000:0.0:1788684231.735906:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:0.0:1788684231.735916:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:11287:x1875571073136384:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788684231.736999:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:11287:x1875571073136384:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 1080us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684231.737010:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:2.0:1788684231.751103:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684231.751295:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073136512 00000100:00100000:3.0:1788684231.751304:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073136512 00000100:00100000:3.0:1788684231.751361:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00100000:3.0:1788684231.751405:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:11287:x1875571073136512:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684231.751423:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684231.751444:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac949 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b33 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.751509:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac950 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.751524:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.751650:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684231.751717:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684231.751737:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.751763:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac949 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b33 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.751780:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b33 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.751789:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:3.0:1788684231.751793:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788684231.751797:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711de00, rc 0) 00000100:00100000:3.0:1788684231.751890:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11287:x1875571073136512:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 487us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684231.751898:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00100000:2.0:1788684231.759708:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.759790:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073136640 00000100:00100000:0.0:1788684231.759800:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073136640 00000100:00100000:0.0:1788684231.759865:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:0.0:1788684231.759875:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073136640:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684231.759892:0:9991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684231.759913:0:9991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b3a expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684231.759937:0:9991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d27c7, blocks: 0x0 00010000:00010000:0.0:1788684231.759955:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=312s v=(0 0) 00010000:00010000:0.0:1788684231.759960:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684231.759969:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b3a expref: 6 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.759988:0:9991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b3a expref: 6 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.760001:0:9991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891000, rc 0) 00000100:00100000:0.0:1788684231.760056:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073136640:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 182us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684231.760063:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:3.0:1788684231.767247:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684231.767306:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073136896 00000100:00100000:1.0:1788684231.767315:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073136896 00000100:00100000:1.0:1788684231.767392:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:1.0:1788684231.767403:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11287:x1875571073136896:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788684231.767572:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6751b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11287:x1875571073136896:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 170us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684231.767580:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:2.0:1788684231.777449:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684231.777844:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073137024 00000100:00100000:3.0:1788684231.777854:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073137024 00000100:00100000:3.0:1788684231.777989:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:3.0:1788684231.778001:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:11287:x1875571073137024:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684231.778017:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684231.778038:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b41 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.778071:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b3a expref: 7 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.778091:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684231.778096:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684231.778103:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.778135:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b3a expref: 7 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.778148:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b3a expref: 7 pid: 9991 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.778163:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875571085796608:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684231.778277:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664186b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684231.781275:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875571085796608:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684231.781310:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.781332:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c000, rc 0) 00000100:00100000:2.0:1788684231.781400:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:11287:x1875571073137024:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 3402us (3959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684231.781410:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:2.0:1788684231.782257:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.782579:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073137152 00000100:00100000:0.0:1788684231.782587:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073137152 00010000:00010000:0.0:1788684231.782623:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b3a expref: 7 pid: 9991 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684231.782656:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:0.0:1788684231.782673:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073137152:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684231.782705:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684231.782727:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b3a expref: 7 pid: 9991 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.782739:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b3a expref: 7 pid: 9991 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.782762:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54ac957 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b3a expref: 7 pid: 9991 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.782787:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684231.782792:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684231.782801:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 6 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.782811:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 6 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.782844:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 6 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684231.782856:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6483:1875571085796736:192.168.206.44@tcp:105: 00000100:00100000:0.0:1788684231.782935:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684231.787438:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6483:1875571085796736:192.168.206.44@tcp:105: 00010000:00010000:1.0:1788684231.787461:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684231.787514:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073137152:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 4850us (5260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684231.787524:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1788684231.792410:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684231.792492:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073137280 00000100:00100000:1.0:1788684231.792501:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073137280 00002000:00100000:1.0:1788684231.792545:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d67450b0000 x1875571073137280/t0(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:152/0 lens 504/0 e 0 to 0 dl 1788684242 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788684231.792555:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67450b0000 with x1875571073137280 ext(0->8) 00002000:00010000:1.0:1788684231.792561:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67450b0000 00000100:00100000:1.0:1788684231.792596:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1788684231.792606:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073137280:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788684231.798679:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2393:x1875571073137280:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 Request processed in 6057us (6260us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788684231.798706:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00002000:00100000:0.0:1788684231.798719:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8d67450b0000 x1875571073137280/t4294967303(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:152/0 lens 504/448 e 0 to 0 dl 1788684242 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788684231.798729:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67450b0000 with x1875571073137280 ext(0->8) 00002000:00010000:0.0:1788684231.798734:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67450b0000 00000100:00100000:2.0:1788684231.810039:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.810115:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073137408 00000100:00100000:0.0:1788684231.810124:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073137408 00000100:00100000:0.0:1788684231.810177:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 90 00000100:00100000:0.0:1788684231.810187:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11287:x1875571073137408:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788684231.817274:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1788684231.817292:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788684231.817308:0:6476:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:0.0:1788684231.817415:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.817427:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.817435:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.817441:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684231.817446:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.817454:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.817472:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:0.0:1788684231.817475:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788684231.817492:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.817499:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ac934 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788684231.817790:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788684231.817800:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788684231.817817:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085796864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788684231.817881:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684231.818040:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085796864 00000100:00100000:0.0:1788684231.818046:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085796864 00000100:00100000:0.0:1788684231.818101:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684231.818109:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085796864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788684231.818215:0:9991:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788684231.818219:0:9991:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788684231 00002000:00010000:0.0:1788684231.818221:0:9991:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788684231.818223:0:9991:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788684231 -> 1788684231 00002000:00010000:0.0:1788684231.818225:0:9991:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788684231.818263:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085796864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (382us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788684231.818270:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788684231.818449:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684231.819676:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:11287:x1875571073137408:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 8176us (8331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684231.819694:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 90 00000004:00080000:0.0:1788684231.819752:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d66478a1f80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788684231.819759:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085796864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788684231.822474:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.822514:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073137536 00000100:00100000:2.0:1788684231.822523:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073137536 00000100:00100000:2.0:1788684231.822578:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:2.0:1788684231.822589:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073137536:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788684231.841703:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788684231.841717:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788684231.842512:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073137536:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 19918us (20036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684231.842524:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:3.0:1788684231.847575:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.847694:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073137792 00000100:00100000:2.0:1788684231.847704:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073137792 00000100:00100000:2.0:1788684231.847759:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 91 00000100:00100000:2.0:1788684231.847769:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:11287:x1875571073137792:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788684231.847837:0:12443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684231.847861:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ac950 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b33 expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.848077:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:2.0:1788684231.848083:0:12443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684231.848113:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.848125:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.848134:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684231.848241:0:12443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f39cbeb reply state 00000000e6614542 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.848251:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.848264:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:2.0:1788684231.848266:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684231.848269:0:12443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684231.848412:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:11287:x1875571073137792:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 644us (846us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788684231.848419:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 91 00000100:00100000:2.0:1788684231.853803:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.853834:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073137920 00000100:00100000:2.0:1788684231.853842:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073137920 00000100:00100000:2.0:1788684231.854039:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:2.0:1788684231.854050:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073137920:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788684231.854206:0:9991:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788684231.854210:0:9991:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788684231 -> 1788684230 00002000:00010000:2.0:1788684231.854213:0:9991:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788684229 00002000:00010000:2.0:1788684231.854215:0:9991:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788684231 -> 1788684230 00002000:00010000:2.0:1788684231.854218:0:9991:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788684231.854277:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073137920:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 229us (480us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788684231.854285:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:3.0:1788684231.857204:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.857288:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073138176 00000100:00100000:2.0:1788684231.857297:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073138176 00000100:00100000:2.0:1788684231.857349:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 92 00000100:00100000:2.0:1788684231.857358:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:11287:x1875571073138176:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788684231.857617:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.857647:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b25 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.857656:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.857699:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b25 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.857715:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b25 expref: 15 pid: 6497 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684231.857728:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085796992:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684231.857810:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647bd9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788684231.860337:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085796992:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684231.860416:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.861673:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.861993:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073138304 00000100:00100000:2.0:1788684231.862001:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073138304 00010000:00010000:2.0:1788684231.862037:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b25 expref: 16 pid: 6497 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684231.862079:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:2.0:1788684231.862088:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:2392:x1875571073138304:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684231.862101:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684231.862108:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b25 expref: 16 pid: 6497 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.862136:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b25 expref: 16 pid: 6497 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.862164:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ac92d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b25 expref: 16 pid: 6497 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.862179:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:2.0:1788684231.862184:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.862194:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.862201:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.862228:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684231.862273:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:2392:x1875571073138304:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 185us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684231.862281:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00010000:00010000:3.0:1788684231.862302:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.862313:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.862346:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.862353:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.862360:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.862403:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684231.862407:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.862414:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.862424:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:3.0:1788684231.862427:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788684231.862431:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.862437:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ac96c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.862532:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:11287:x1875571073138176:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 Request processed in 5174us (5336us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788684231.862551:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 92 00000100:00100000:3.0:1788684231.866628:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.867560:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073138432 00000100:00100000:2.0:1788684231.867571:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073138432 00000100:00100000:2.0:1788684231.867619:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:2.0:1788684231.867627:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2390:x1875571073138432:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788684231.867677:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.867695:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.867720:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684231.867724:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684231.867729:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.867760:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.867774:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 7 pid: 8411 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684231.867787:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875571085797120:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684231.867866:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647bd9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684231.876584:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684231.876673:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073138560 00000100:00100000:0.0:1788684231.876679:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875571085797120:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684231.876682:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073138560 00010000:00010000:0.0:1788684231.876717:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.876722:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 8 pid: 8411 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.876817:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:3.0:1788684231.876828:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2393:x1875571073138560:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684231.876842:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684231.876864:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 8 pid: 8411 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.876878:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 8 pid: 8411 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.876902:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac76ca68/0x44bac02bd54ac95e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b41 expref: 8 pid: 8411 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.876921:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684231.876925:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684231.876940:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.876950:0:9510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.876992:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788684231.877022:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.877033:0:8411:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.877053:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.877061:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.877069:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.877076:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684231.877080:0:8411:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.877087:0:8411:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.877098:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.877112:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ac973 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.878183:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073138560:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 1352us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684231.878192:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:0.0:1788684231.879134:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073138432:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 11503us (12510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684231.879146:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:0.0:1788684231.889730:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684231.889955:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073138816 00000100:00100000:2.0:1788684231.889964:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073138816 00000100:00100000:2.0:1788684231.890015:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 93 00000100:00100000:2.0:1788684231.890026:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:11287:x1875571073138816:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788684231.890092:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.890107:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aca expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.890117:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.890160:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aca expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.890173:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aca expref: 14 pid: 6498 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684231.890187:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085797248:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684231.890262:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647bd9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684231.894407:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085797248:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684231.894434:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684231.894727:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684231.895027:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073138944 00000100:00100000:3.0:1788684231.895034:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073138944 00010000:00010000:3.0:1788684231.895068:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aca expref: 15 pid: 6498 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.895106:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:3.0:1788684231.895124:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:2392:x1875571073138944:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684231.895137:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684231.895143:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aca expref: 15 pid: 6498 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.895156:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aca expref: 15 pid: 6498 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.895177:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ac7ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3aca expref: 15 pid: 6498 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.895191:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684231.895195:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.895204:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.895226:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.895253:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684231.895305:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:2392:x1875571073138944:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 182us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684231.895313:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00010000:00010000:0.0:1788684231.896689:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.896704:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.896862:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.896877:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b2c expref: 14 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.896886:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.897056:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b2c expref: 14 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.897083:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b2c expref: 14 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684231.897098:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085797376:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684231.897236:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684231.904514:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684231.904602:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073139072 00000100:00100000:1.0:1788684231.904614:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073139072 00010000:00010000:1.0:1788684231.904654:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b2c expref: 15 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684231.904715:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:1.0:1788684231.904726:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:2393:x1875571073139072:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684231.904740:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684231.904757:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b2c expref: 15 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.904771:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b2c expref: 15 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.904793:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:1.0:1788684231.904798:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.904808:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.904816:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.904832:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684231.904881:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:2393:x1875571073139072:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 158us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684231.905026:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00010000:00010000:2.0:1788684231.905156:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac93b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b2c expref: 14 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684231.905172:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085797376:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684231.905192:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.905201:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.905206:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684231.905306:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788684231.906341:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788684231.906405:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788684231.906481:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875571085797504:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788684231.906534:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684231.906577:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674890b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788684231.906594:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085797504 00000100:00100000:3.0:1788684231.906601:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085797504 00000100:00100000:3.0:1788684231.906647:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788684231.906655:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6497:x1875571085797504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788684231.906755:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6497:x1875571085797504:12345-0@lo:1000:mdt00_000.0 Request processed in 100us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684231.906763:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788684231.906785:0:6497:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788684231.906792:0:6497:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d66478a1f80, transno 4294967304 00000100:00100000:2.0:1788684231.906820:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875571085797504:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788684231.907032:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788684231.907078:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875571085797632:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788684231.907106:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684231.907132:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674890b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684231.907321:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085797632 00000100:00100000:3.0:1788684231.907326:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085797632 00000100:00100000:3.0:1788684231.907357:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788684231.907389:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6497:x1875571085797632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788684231.907495:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6497:x1875571085797632:12345-0@lo:1000:mdt00_000.0 Request processed in 131us (388us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788684231.907502:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788684231.907535:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875571085797632:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788684231.907569:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907653:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907671:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907678:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684231.907682:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907745:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907761:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:2.0:1788684231.907765:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684231.907770:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907776:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ac981 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907818:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907825:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907830:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907835:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684231.907839:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907845:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907854:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684231.907857:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684231.907860:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907865:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54ac8af lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.907998:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.908014:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b10 expref: 17 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.908023:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.908055:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b10 expref: 17 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.908069:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b10 expref: 17 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684231.908080:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085797760:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684231.908188:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674890b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684231.912450:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085797760:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684231.912483:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.913180:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684231.913494:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073139200 00000100:00100000:0.0:1788684231.913502:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073139200 00010000:00010000:0.0:1788684231.913546:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b10 expref: 18 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684231.913589:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:0.0:1788684231.913600:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2392:x1875571073139200:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684231.913612:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684231.913619:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b10 expref: 18 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.913631:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b10 expref: 18 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.913651:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ac8cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b10 expref: 18 pid: 13784 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.913674:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684231.913679:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.913699:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.913706:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684231.913733:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684231.913763:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913773:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684231.913782:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:2392:x1875571073139200:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 183us (603us total) trans 0 rc 0/0 00010000:00010000:2.0:1788684231.913785:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684231.913794:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00010000:00010000:2.0:1788684231.913798:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913806:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913812:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684231.913816:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913831:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913841:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684231.913843:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684231.913847:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913852:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ac988 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913862:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913867:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913872:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913877:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684231.913879:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913884:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913904:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684231.913906:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788684231.913909:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684231.913924:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ac97a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684231.914058:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:11287:x1875571073138816:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 24034us (24336us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788684231.914067:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 93 00000020:00080000:2.0:1788684231.914071:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788684231.914173:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788684231.914178:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788684231.914190:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788684231.914195:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684231.916621:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684231.916764:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073139456 00000100:00100000:3.0:1788684231.916785:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073139456 00000100:00100000:3.0:1788684231.916939:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:3.0:1788684231.916951:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:11287:x1875571073139456:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788684231.917184:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788684231.917218:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788684231.917249:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.917265:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.917276:0:6501:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.917284:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.917291:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.917297:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684231.917428:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684231.917585:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684231.917593:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.917601:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:11287:x1875571073139456:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 650us (986us total) trans 4294967364 rc 0/0 00010000:00010000:1.0:1788684231.917603:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684231.917610:0:6485:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684231.917616:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00010000:00010000:1.0:1788684231.917623:0:6485:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788684231.917624:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788684231.917650:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:1.0:1788684231.917652:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788684231.917656:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.917673:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ac98f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684231.917694:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684231.917696:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684231.917698:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684232.321080:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684232.375979:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684232.376024:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684232.376053:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684232.376091:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684232.376243:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073139584 00000100:00100000:0.0:1788684232.376253:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073139584 00000100:00100000:0.0:1788684232.376316:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 377 00000100:00100000:0.0:1788684232.376326:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073139584:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684232.376413:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073139584:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 88us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684232.376420:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 377 00000100:00100000:2.0:1788684232.376669:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073139840 00000100:00100000:2.0:1788684232.376674:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073139840 00000100:00100000:2.0:1788684232.376720:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073139712 00000100:00100000:2.0:1788684232.376722:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073139712 00000100:00100000:2.0:1788684232.376742:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 261 00000100:00100000:2.0:1788684232.376749:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073139840:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684232.376783:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073139840:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 35us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684232.376790:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 261 00000100:00100000:2.0:1788684232.376804:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 262 00000100:00100000:2.0:1788684232.376810:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2392:x1875571073139712:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684232.376836:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2392:x1875571073139712:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684232.376841:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 262 00000100:00100000:2.0:1788684232.376860:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073139968 00000100:00100000:2.0:1788684232.376863:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073139968 00000100:00100000:2.0:1788684232.376888:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:2.0:1788684232.376895:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073139968:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684232.376946:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073139968:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 52us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684232.376952:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00080000:0.0:1788684232.377235:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684232.377240:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684232.377242:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684232.377272:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684232.377329:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684232.377388:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684232.377585:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073140224 00000100:00100000:2.0:1788684232.377596:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073140224 00000100:00100000:2.0:1788684232.377643:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073140352 00000100:00100000:2.0:1788684232.377647:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073140352 00000100:00100000:3.0:1788684232.377699:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073140096 00000100:00080000:0.0:1788684232.377714:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684232.377715:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073140096 00000100:00080000:0.0:1788684232.377722:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684232.377796:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 99 00000100:00100000:3.0:1788684232.377822:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073140096:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684232.383494:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 263 00000100:00100000:2.0:1788684232.383517:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073140224:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684232.384752:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073140224:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 1232us (7465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684232.384769:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 263 00000100:00100000:2.0:1788684232.384818:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 264 00000100:00100000:2.0:1788684232.384833:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073140352:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684232.384918:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073140352:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 92us (7529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684232.384925:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 264 00000100:00100000:3.0:1788684232.390145:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073140096:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 12308us (12797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684232.390165:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 99 00010000:00010000:1.0:1788684233.341866:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788684233.439264:0:14236:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788684233.439274:0:14236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788684233.439296:0:14236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788684233.439302:0:14236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684233.547175:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684233.547249:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073140608 00000100:00100000:1.0:1788684233.547259:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073140608 00000100:00100000:1.0:1788684233.547320:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 94 00000100:00100000:1.0:1788684233.547330:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:11306:x1875571073140608:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684233.547719:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684233.547741:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b48 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.547862:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac99d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.547875:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac99d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.547885:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac99d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684233.547895:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788684233.547990:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54ac996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b48 expref: 21 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.548007:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac99d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b48 expref: 20 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.548016:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:1.0:1788684233.548019:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788684233.548023:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0200, rc 0) 00000100:00100000:1.0:1788684233.548082:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:11306:x1875571073140608:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 754us (916us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788684233.548089:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 94 00000100:00100000:1.0:1788684233.554566:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684233.554780:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073140736 00000100:00100000:0.0:1788684233.554796:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073140736 00000100:00100000:0.0:1788684233.554853:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 95 00000100:00100000:0.0:1788684233.554863:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:11306:x1875571073140736:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:0.0:1788684233.554936:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.554953:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.554965:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.554982:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.554990:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.554997:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555071:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555080:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555087:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788684233.555174:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555199:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555205:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555212:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555217:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.555222:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555230:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555243:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684233.555246:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684233.555250:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555256:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555266:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555272:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555277:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555287:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.555291:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555296:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555304:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869c00) 00010000:00010000:0.0:1788684233.555306:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684233.555309:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555314:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555329:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555334:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555339:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555344:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.555347:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.555352:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.556730:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869900) 00010000:00010000:0.0:1788684233.556735:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684233.556740:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.556748:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684233.556842:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:11306:x1875571073140736:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 1977us (2281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.556851:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 95 00000100:00100000:3.0:1788684233.593399:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684233.593483:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073140992 00000100:00100000:0.0:1788684233.593492:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073140992 00000100:00100000:0.0:1788684233.593696:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 96 00000100:00100000:0.0:1788684233.593705:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:11309:x1875571073140992:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684233.593725:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684233.593744:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b4f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.593894:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.593908:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.593919:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.593931:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.593949:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.593955:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594049:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594056:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594064:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684233.594072:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788684233.594132:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594139:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594146:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594152:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.594156:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594164:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594184:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684233.594187:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684233.594192:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594198:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ac9c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594210:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594215:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594221:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594227:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.594229:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594235:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594241:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869900) 00010000:00010000:0.0:1788684233.594243:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684233.594246:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594251:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ac9ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594293:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ac9c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b4f expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594305:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b4f expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.594313:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684233.594315:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684233.594317:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890400, rc 0) 00000100:00100000:0.0:1788684233.595109:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11309:x1875571073140992:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1401us (1744us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788684233.595119:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 96 00000100:00100000:0.0:1788684233.598643:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684233.598713:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073141120 00000100:00100000:3.0:1788684233.598723:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073141120 00000100:00100000:3.0:1788684233.598835:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:3.0:1788684233.598845:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11309:x1875571073141120:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:3.0:1788684233.598903:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.598918:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.598928:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.598957:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.598964:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.598971:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.598976:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684233.598980:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.598998:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.599009:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:3.0:1788684233.599012:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684233.599017:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.599023:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684233.599143:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11309:x1875571073141120:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 299us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684233.599150:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:1.0:1788684233.601843:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684233.601968:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073141376 00000100:00100000:2.0:1788684233.601977:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073141376 00000100:00100000:2.0:1788684233.602045:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:2.0:1788684233.602054:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749556450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11309:x1875571073141376:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684233.602225:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749556450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:11309:x1875571073141376:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 172us (388us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788684233.602233:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:0.0:1788684233.645484:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684233.645530:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073141632 00000100:00100000:1.0:1788684233.645544:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073141632 00000100:00100000:1.0:1788684233.645622:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:1.0:1788684233.645634:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:10828:x1875571073141632:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1788684233.645802:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684233.645830:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac9ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b56 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.645984:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.646002:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b4f expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.646013:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.646059:0:7963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b4f expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.646077:0:7963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b4f expref: 24 pid: 6497 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684233.646092:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085797888:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684233.646235:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67453980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684233.649053:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684233.649151:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073141760 00000100:00100000:3.0:1788684233.649163:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073141760 00000100:00100000:1.0:1788684233.650909:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085797888:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684233.650952:0:7963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.651745:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b4f expref: 25 pid: 6497 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684233.651801:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:3.0:1788684233.651824:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:2392:x1875571073141760:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684233.651841:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684233.651849:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b4f expref: 25 pid: 6497 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.651864:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b4f expref: 25 pid: 6497 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.651907:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ac9d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b4f expref: 25 pid: 6497 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.651936:0:9510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:3.0:1788684233.651942:0:9510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.651953:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.651961:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.652000:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684233.652040:0:7963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.652055:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684233.652075:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:2392:x1875571073141760:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 263us (3040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684233.652090:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00000004:00200000:1.0:1788684233.652645:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788684233.652834:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54ac9ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b56 expref: 25 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.652858:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b56 expref: 24 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.654099:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684233.654108:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788684233.654209:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0400, rc 0) 00000100:00100000:1.0:1788684233.654346:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:10828:x1875571073141632:12345-192.168.206.44@tcp:101:bash.0 Request processed in 8708us (8871us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788684233.654356:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:0.0:1788684233.657043:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684233.657127:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073141888 00000100:00100000:3.0:1788684233.657138:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073141888 00000100:00100000:3.0:1788684233.657202:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 99 00000100:00100000:3.0:1788684233.657212:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:10828:x1875571073141888:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684233.657241:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684233.657264:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b5d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.657305:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54aca06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.657343:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54aca06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.657355:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54aca06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.657545:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ac9ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b5d expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.657563:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54aca06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b5d expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.657574:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:3.0:1788684233.657577:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788684233.657580:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d400, rc 0) 00000100:00100000:3.0:1788684233.657645:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:10828:x1875571073141888:12345-192.168.206.44@tcp:101:bash.0 Request processed in 434us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684233.657664:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 99 00000100:00100000:2.0:1788684233.664254:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684233.664413:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073142144 00000100:00100000:1.0:1788684233.664426:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073142144 00000100:00100000:1.0:1788684233.664503:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 100 00000100:00100000:1.0:1788684233.664515:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:10828:x1875571073142144:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:1.0:1788684233.664905:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.664929:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.664943:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788684233.665000:0:13784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788684233.665042:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2153a76 reply state 0000000058b272e9 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.665057:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.665066:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684233.665070:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684233.665075:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788684233.665169:0:13784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788684233.665302:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:10828:x1875571073142144:12345-192.168.206.44@tcp:36:bash.0 Request processed in 787us (1061us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788684233.665311:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 100 00000020:00080000:1.0:1788684233.665317:0:13784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788684233.668337:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684233.668668:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073142272 00000100:00100000:0.0:1788684233.668682:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073142272 00000100:00100000:0.0:1788684233.668795:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 101 00000100:00100000:0.0:1788684233.668807:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:10828:x1875571073142272:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1788684233.668838:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684233.668867:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54aca14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b64 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.668949:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54aca14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b64 expref: 30 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.668993:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54aca14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b64 expref: 30 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.669020:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684233.669024:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788684233.669028:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891200, rc 0) 00000100:00100000:0.0:1788684233.669107:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:10828:x1875571073142272:12345-192.168.206.44@tcp:101:bash.0 Request processed in 303us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.669114:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 101 00000100:00100000:2.0:1788684233.672095:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684233.672212:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073142400 00000100:00100000:0.0:1788684233.672224:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073142400 00000100:00100000:0.0:1788684233.672349:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:0.0:1788684233.672362:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:10828:x1875571073142400:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1788684233.672414:0:9991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684233.672440:0:9991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b6b expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684233.672472:0:9991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9d27c6, atime: 0x6a9d27c5, ctime: 0x6a9d27c6, blocks: 0x8 00010000:00010000:0.0:1788684233.672500:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:0.0:1788684233.672505:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684233.672514:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b6b expref: 7 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.672649:0:9991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b6b expref: 7 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.672699:0:9991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891c00, rc 0) 00000100:00100000:0.0:1788684233.672777:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:10828:x1875571073142400:12345-192.168.206.44@tcp:101:bash.0 Request processed in 416us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.672785:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00080000:3.0:1788684233.674788:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684233.675036:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684233.675123:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073142528 00000100:00100000:0.0:1788684233.675135:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073142528 00002000:00010000:0.0:1788684233.675190:0:8416:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788684233.675196:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d66477eed80 with x1875571073142528 ext(0->18446744073709551615) 00002000:00010000:0.0:1788684233.675211:0:8416:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d66477eed80. 00000100:00100000:0.0:1788684233.675249:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:0.0:1788684233.675261:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073142528:12345-192.168.206.44@tcp:10:bash.0 00002000:00010000:0.0:1788684233.675785:0:8416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788684233.675789:0:8416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788684230 -> 1788684233 00002000:00010000:0.0:1788684233.675792:0:8416:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788684229 -> 1788684229 00002000:00010000:0.0:1788684233.675795:0:8416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788684230 -> 1788684233 00002000:00010000:0.0:1788684233.675797:0:8416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788684233.675916:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073142528:12345-192.168.206.44@tcp:10:bash.0 Request processed in 657us (885us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788684233.675925:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00002000:00010000:0.0:1788684233.675929:0:8416:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1788684233.675932:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d66477eed80 with x1875571073142528 ext(0->18446744073709551615) 00002000:00010000:0.0:1788684233.675937:0:8416:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d66477eed80. 00000100:00100000:1.0:1788684233.731438:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684233.731551:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073142656 00000100:00100000:3.0:1788684233.731564:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073142656 00000100:00100000:3.0:1788684233.731624:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 102 00000100:00100000:3.0:1788684233.731634:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:11323:x1875571073142656:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:3.0:1788684233.731740:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.731761:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.731796:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.731819:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.731828:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.731834:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.731929:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.731939:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.731945:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788684233.732000:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732012:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732019:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732026:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732043:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684233.732048:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732056:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732074:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:3.0:1788684233.732078:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684233.732084:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732090:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732106:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732166:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732173:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732177:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684233.732180:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732186:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732204:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d677cc3c200) 00010000:00010000:3.0:1788684233.732207:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684233.732210:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732216:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732232:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732239:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732245:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732250:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684233.732253:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732259:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732267:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:3.0:1788684233.732270:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684233.732273:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.732279:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684233.732685:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:11323:x1875571073142656:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 1049us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684233.732695:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 102 00000100:00100000:2.0:1788684233.764263:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684233.764502:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073142912 00000100:00100000:3.0:1788684233.764516:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073142912 00000100:00100000:3.0:1788684233.764592:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 103 00000100:00100000:3.0:1788684233.764604:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:11326:x1875571073142912:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684233.764629:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684233.764669:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b72 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.764764:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.764790:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.764806:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.764824:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.764831:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.764838:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.764999:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54aca4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765010:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54aca4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765018:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54aca4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684233.765028:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788684233.765126:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765135:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765143:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765149:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684233.765153:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765162:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765177:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:3.0:1788684233.765180:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684233.765186:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765203:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54aca3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765219:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765226:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765232:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765236:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684233.765239:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765245:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765253:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d677cc3c200) 00010000:00010000:3.0:1788684233.765255:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684233.765258:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765263:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54aca45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765310:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54aca37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b72 expref: 33 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765325:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54aca4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b72 expref: 32 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.765341:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:3.0:1788684233.765343:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788684233.765346:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711de00, rc 0) 00000100:00100000:3.0:1788684233.765503:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:11326:x1875571073142912:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 901us (1255us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788684233.765512:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 103 00000100:00100000:2.0:1788684233.770808:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684233.771762:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073143040 00000100:00100000:1.0:1788684233.771849:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073143040 00000100:00100000:1.0:1788684233.771998:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 104 00000100:00100000:1.0:1788684233.772011:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:11326:x1875571073143040:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:1.0:1788684233.772097:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.772119:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b56 expref: 32 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.772130:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.772173:0:7963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b56 expref: 32 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.772213:0:7963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b56 expref: 32 pid: 7963 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684233.772232:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbf6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085798016:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684233.772362:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67453983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684233.779362:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684233.779574:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbf6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085798016:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684233.779633:0:7963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684233.779816:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073143296 00000100:00100000:3.0:1788684233.779825:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073143296 00000100:00100000:3.0:1788684233.779950:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:3.0:1788684233.779961:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+33:6159:x1875571073143296:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788684233.780559:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+34:6159:x1875571073143296:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 597us (1210us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788684233.780570:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1788684233.784497:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684233.784740:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073143424 00000100:00100000:3.0:1788684233.784753:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073143424 00010000:00010000:3.0:1788684233.784805:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b56 expref: 34 pid: 7963 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684233.784857:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:3.0:1788684233.784987:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+34:2393:x1875571073143424:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684233.785010:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684233.785019:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b56 expref: 34 pid: 7963 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.785035:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b56 expref: 34 pid: 7963 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.785083:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54ac9f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b56 expref: 34 pid: 7963 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.785103:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:3.0:1788684233.785109:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.785120:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.785129:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.785166:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684233.785238:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+33:2393:x1875571073143424:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 371us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684233.785247:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00010000:00010000:0.0:1788684233.785312:0:7963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.785323:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.785407:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.785416:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.785424:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.785431:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.785437:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.785445:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.785455:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684233.785458:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788684233.785463:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.785470:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54aca5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684233.785537:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:11326:x1875571073143040:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 13530us (14743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.785546:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 104 00000100:00100000:1.0:1788684233.787325:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684233.787590:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073143680 00000100:00100000:2.0:1788684233.787601:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073143680 00000100:00100000:2.0:1788684233.788679:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:2.0:1788684233.788703:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:11326:x1875571073143680:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684233.789016:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+33:11326:x1875571073143680:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 321us (1698us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788684233.789025:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:0.0:1788684233.854436:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684233.854465:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085798144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684233.854558:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684233.854646:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085798144 00000100:00100000:2.0:1788684233.854667:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085798144 00000100:00100000:2.0:1788684233.854869:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788684233.854879:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684233.854882:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085798144:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684233.854897:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085798272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684233.854940:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788684233.854943:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684233.854977:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085798272 00000100:00100000:3.0:1788684233.854992:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085798272 00000100:00100000:2.0:1788684233.855009:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085798144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684233.855018:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788684233.855111:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085798144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684233.855142:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085798528:0@lo:400:kworker.0 00000100:00100000:2.0:1788684233.855188:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085798400:0@lo:400:kworker.0 00000100:00100000:1.0:1788684233.855196:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684233.855232:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085799040:0@lo:400:kworker.0 00000100:00100000:2.0:1788684233.855238:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684233.855271:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085798912:0@lo:400:kworker.0 00000100:00100000:1.0:1788684233.855272:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684233.855306:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085799552:0@lo:400:kworker.0 00000100:00100000:2.0:1788684233.855315:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684233.855346:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684233.855361:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085799424:0@lo:400:kworker.0 00000100:00100000:1.0:1788684233.855409:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788684233.855417:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684233.855421:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085798656:0@lo:400:kworker.0 00000100:00100000:2.0:1788684233.855443:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788684233.855451:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085798784:0@lo:400:kworker.0 00000100:00100000:1.0:1788684233.855459:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684233.855487:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684233.855487:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085799168:0@lo:400:kworker.0 00000100:00100000:2.0:1788684233.855515:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085799296:0@lo:400:kworker.0 00000100:00100000:1.0:1788684233.855523:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684233.855550:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085799680:0@lo:400:kworker.0 00000100:00100000:2.0:1788684233.855551:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684233.855584:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684233.855588:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085798528 00000100:00100000:2.0:1788684233.855595:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085798528 00000100:00100000:1.0:1788684233.855622:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085799552 00000100:00100000:2.0:1788684233.855625:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085799040 00000100:00100000:1.0:1788684233.855628:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085799552 00000100:00100000:2.0:1788684233.855630:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085799040 00000100:00080000:0.0:1788684233.856453:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684233.856461:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684233.856464:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684233.856483:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085798912 00000100:00100000:0.0:1788684233.856490:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085798912 00000100:00100000:0.0:1788684233.856533:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085798656 00000100:00100000:0.0:1788684233.856536:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085798656 00000100:00100000:0.0:1788684233.856553:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788684233.856562:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085798912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.857005:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085798912:12345-0@lo:400:kworker.0 Request processed in 442us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.857014:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788684233.857033:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788684233.857040:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085798656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.857075:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085798656:12345-0@lo:400:kworker.0 Request processed in 35us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.857082:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788684233.857131:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085798912:0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.857170:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085798656:0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.857220:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085799424 00000100:00100000:0.0:1788684233.857225:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085799424 00000100:00100000:0.0:1788684233.857252:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085798784 00000100:00100000:0.0:1788684233.857255:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085798784 00000100:00100000:0.0:1788684233.857266:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085799168 00000100:00100000:0.0:1788684233.857268:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085799168 00000100:00100000:0.0:1788684233.857283:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085799296 00000100:00100000:0.0:1788684233.857286:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085799296 00000100:00100000:0.0:1788684233.857301:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788684233.857307:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085798528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.857346:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085798528:12345-0@lo:400:kworker.0 Request processed in 39us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.857353:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788684233.857390:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788684233.857397:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085799424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.857430:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085799424:12345-0@lo:400:kworker.0 Request processed in 34us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.857437:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788684233.857448:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788684233.857454:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085798784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.857480:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085798784:12345-0@lo:400:kworker.0 Request processed in 26us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.857486:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788684233.857496:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788684233.857502:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085799168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.857529:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085799168:12345-0@lo:400:kworker.0 Request processed in 27us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.857544:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788684233.857556:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788684233.857562:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085799296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.861206:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085799296:12345-0@lo:400:kworker.0 Request processed in 3634us (5647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.861224:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788684233.861341:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085798784:0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.861357:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085799296:0@lo:400:kworker.0 00010000:00080000:0.0:1788684233.861396:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664799dc00 x1875571085799424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684233.861409:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085799424:0@lo:400:kworker.0 00010000:00080000:0.0:1788684233.861466:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664799ce00 x1875571085799168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684233.861477:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085799168:0@lo:400:kworker.0 00000100:00100000:0.0:1788684233.861492:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085798528:0@lo:400:kworker.0 00000100:00080000:0.0:1788684233.861520:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684233.861526:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684233.861638:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085799680 00000100:00100000:0.0:1788684233.861646:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085799680 00000100:00100000:0.0:1788684233.861729:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788684233.861740:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085799680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684233.862813:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788684233.862826:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085798272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684233.862855:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684233.863034:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085798272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (8093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684233.863065:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788684233.863149:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085798272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684233.863225:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085798400 00000100:00100000:3.0:1788684233.863231:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085798400 00000100:00100000:3.0:1788684233.863264:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788684233.863271:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085798400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684233.863314:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6758f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085798400:12345-0@lo:400:kworker.0 Request processed in 44us (8080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684233.863321:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788684233.863400:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085798400:0@lo:400:kworker.0 00000100:00080000:3.0:1788684233.863444:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684233.864250:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085799680:12345-0@lo:400:kworker.0 Request processed in 2506us (8660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.864279:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788684233.864440:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788684233.864452:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085799040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684233.864507:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085799040:12345-0@lo:400:kworker.0 Request processed in 59us (9238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684233.864514:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788684233.864729:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085799680:0@lo:400:kworker.0 00000100:00100000:3.0:1788684233.864747:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085799040:0@lo:400:kworker.0 00000100:00100000:1.0:1788684233.869103:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788684233.869247:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085799552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684233.869435:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085799552:12345-0@lo:400:kworker.0 Request processed in 195us (14090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684233.869444:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788684233.869672:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085799552:0@lo:400:kworker.0 00000100:00100000:2.0:1788684233.874811:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684233.874976:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073143936 00000100:00100000:0.0:1788684233.875057:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073143936 00000100:00100000:0.0:1788684233.875298:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 105 00000100:00100000:0.0:1788684233.875312:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+33:11337:x1875571073143936:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:0.0:1788684233.875345:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684233.875407:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b79 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875502:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875529:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875549:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875567:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875583:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875590:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875766:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54aca76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875776:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54aca76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875808:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54aca76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684233.875826:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788684233.875962:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875970:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.875977:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876108:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.876256:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876266:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876280:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684233.876284:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684233.876289:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876297:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876314:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876320:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876334:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876339:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.876362:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876427:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876436:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869200) 00010000:00010000:0.0:1788684233.876439:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684233.876442:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876449:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876537:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b79 expref: 36 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876554:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54aca76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b79 expref: 35 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.876562:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684233.876564:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684233.876567:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890c00, rc 0) 00000100:00100000:0.0:1788684233.876708:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:11337:x1875571073143936:12345-192.168.206.44@tcp:101:cat.0 Request processed in 1399us (1910us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788684233.876726:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 105 00000100:00100000:0.0:1788684233.881824:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684233.882163:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073144192 00000100:00100000:3.0:1788684233.882173:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073144192 00000100:00100000:3.0:1788684233.882235:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:3.0:1788684233.882245:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:11337:x1875571073144192:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:3.0:1788684233.882769:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+36:11337:x1875571073144192:12345-192.168.206.44@tcp:35:cat.0 Request processed in 523us (951us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788684233.882777:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:3.0:1788684233.898356:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684233.898500:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073144448 00000100:00100000:0.0:1788684233.898510:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073144448 00000100:00100000:0.0:1788684233.898576:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00100000:0.0:1788684233.898587:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+36:11338:x1875571073144448:12345-192.168.206.44@tcp:36:rm.0 00010000:00010000:0.0:1788684233.898642:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788684233.898687:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54aca14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b64 expref: 36 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898708:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54aca76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b79 expref: 35 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898719:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54aca4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b72 expref: 34 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898731:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54aca06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b5d expref: 33 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898740:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684233.898745:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788684233.898767:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898780:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898788:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898816:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898823:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898830:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898899:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898908:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.898914:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684233.899100:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788684233.899109:0:13784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314892741933ns, next at 315892739680ns, rc = 0 00010000:00010000:0.0:1788684233.899147:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899156:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899163:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899170:0:13784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899186:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899192:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899205:0:13784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684233.899220:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899226:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899232:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899237:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.899242:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899248:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899256:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684233.899259:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788684233.899263:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899268:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54aca92 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899281:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899292:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899297:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899301:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684233.899304:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899310:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899317:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684233.899319:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684233.899322:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899327:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54aca84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788684233.899337:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b97ca1e6 reply state 000000001f066111 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899346:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.899352:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869200) 00010000:00010000:0.0:1788684233.899354:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788684233.899356:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788684233.899471:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+34:11338:x1875571073144448:12345-192.168.206.44@tcp:36:rm.0 Request processed in 886us (1124us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788684233.899484:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 106 00010000:00010000:1.0:1788684233.899780:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684233.899787:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.899794:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684233.899797:0:6485:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.899804:0:6485:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.899813:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684233.899815:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788684233.899818:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.899823:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54aca99 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.899834:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684233.899836:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684233.899838:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684233.952703:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684233.952781:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073144704 00000100:00100000:2.0:1788684233.952798:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073144704 00000100:00100000:2.0:1788684233.952883:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 107 00000100:00100000:2.0:1788684233.952893:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+34:11344:x1875571073144704:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684233.952918:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684233.952950:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acaa0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b80 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953056:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953084:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953095:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953107:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953114:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953121:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788684233.953468:0:12443:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788684233.953602:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953612:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953619:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953664:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953671:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953678:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953690:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684233.953695:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953703:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953716:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684233.953719:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684233.953724:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953730:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acaa7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684233.953743:0:12443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3e45262 reply state 00000000aba20d7c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953753:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953759:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869200) 00010000:00010000:2.0:1788684233.953761:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684233.953764:0:12443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788684233.953791:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acaa0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b80 expref: 37 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953805:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b80 expref: 36 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684233.953825:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6647580300) 00010000:00010000:2.0:1788684233.953828:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684233.953830:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4a00, rc 0) 00000100:00100000:2.0:1788684233.953898:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:11344:x1875571073144704:12345-192.168.206.44@tcp:101:bash.0 Request processed in 1007us (1214us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788684233.953906:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 107 00000100:00100000:0.0:1788684233.957458:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684233.959387:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073144832 00000100:00100000:3.0:1788684233.959426:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073144832 00000100:00100000:3.0:1788684233.959730:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:3.0:1788684233.959744:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2390:x1875571073144832:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684233.959766:0:9991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684233.959793:0:9991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b87 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788684233.959824:0:9991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684233.959850:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1788684233.959854:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684233.959865:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b87 expref: 8 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.959886:0:9991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b87 expref: 8 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684233.959902:0:9991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711cc00, rc 0) 00000100:00100000:3.0:1788684233.959989:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2390:x1875571073144832:12345-192.168.206.44@tcp:101:bash.0 Request processed in 238us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684233.959997:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:3.0:1788684233.970778:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684233.971610:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073144960 00000100:00100000:1.0:1788684233.971624:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073144960 00000100:00100000:1.0:1788684233.971751:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:1.0:1788684233.971762:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:11344:x1875571073144960:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1788684233.971792:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684233.971811:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b8e expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.971841:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b87 expref: 9 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.971850:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684233.971854:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684233.971859:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.971891:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b87 expref: 9 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.971904:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b87 expref: 9 pid: 9991 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684233.971916:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbf6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8411:1875571085799808:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684233.972005:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684233.982963:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684233.983852:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbf6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8411:1875571085799808:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684233.983913:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684233.983943:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0400, rc 0) 00000100:00100000:0.0:1788684233.984036:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:11344:x1875571073144960:12345-192.168.206.44@tcp:101:bash.0 Request processed in 12274us (13273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684233.984046:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:1.0:1788684233.993730:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073145088 00000100:00100000:1.0:1788684233.993744:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073145088 00010000:00010000:1.0:1788684233.993793:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b87 expref: 9 pid: 9991 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684233.993912:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1788684233.993932:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2393:x1875571073145088:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684233.993948:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684233.993969:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b87 expref: 9 pid: 9991 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.993983:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b87 expref: 9 pid: 9991 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.994004:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000916ad655/0x44bac02bd54acac3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b87 expref: 9 pid: 9991 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.994020:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684233.994025:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684233.994033:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.994044:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684233.994090:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684233.994103:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6483:1875571085799936:192.168.206.44@tcp:105: 00000100:00100000:1.0:1788684233.994193:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398180 going to sleep for 11 seconds 00000100:00100000:0.0:1788684234.002480:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6483:1875571085799936:192.168.206.44@tcp:105: 00010000:00010000:0.0:1788684234.002529:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684234.002614:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2393:x1875571073145088:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 8691us (19661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684234.002628:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1788684234.004572:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.005265:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073145344 00000100:00100000:0.0:1788684234.005276:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073145344 00000100:00100000:0.0:1788684234.005346:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:0.0:1788684234.005356:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:11344:x1875571073145344:12345-192.168.206.44@tcp:35:bash.0 00000100:00080000:3.0:1788684234.005661:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788684234.006052:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967379 00000100:00100000:0.0:1788684234.006300:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:11344:x1875571073145344:12345-192.168.206.44@tcp:35:bash.0 Request processed in 942us (1733us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788684234.006310:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000020:00080000:0.0:1788684234.006315:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788684234.161876:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684234.161994:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073145472 00000100:00100000:2.0:1788684234.162002:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073145472 00000100:00100000:2.0:1788684234.162068:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 108 00000100:00100000:2.0:1788684234.162077:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:11360:x1875571073145472:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684234.162098:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684234.162126:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.162185:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acad8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.162197:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.162760:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684234.162804:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788684234.162808:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684234.162920:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.162965:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b95 expref: 41 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.162983:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acad8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b95 expref: 40 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.162992:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684234.162995:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684234.162998:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5800, rc 0) 00000100:00100000:2.0:1788684234.163057:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+40:11360:x1875571073145472:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 980us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684234.163065:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 108 00000100:00100000:0.0:1788684234.168834:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684234.169058:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073145728 00000100:00100000:1.0:1788684234.169073:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073145728 00000100:00100000:1.0:1788684234.169153:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 109 00000100:00100000:1.0:1788684234.169163:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+40:11360:x1875571073145728:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684234.169183:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684234.169220:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acadf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3b9c expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.169339:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54acae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.169355:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54acae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.169393:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54acae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684234.169404:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788684234.169618:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acadf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b9c expref: 43 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.169637:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54acae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b9c expref: 42 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.169645:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6647580300) 00010000:00010000:1.0:1788684234.169660:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788684234.169663:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0000, rc 0) 00000100:00100000:1.0:1788684234.169741:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+42:11360:x1875571073145728:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 579us (924us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788684234.169749:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 109 00000100:00100000:3.0:1788684234.172181:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684234.172277:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073145984 00000100:00100000:2.0:1788684234.172359:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073145984 00000100:00100000:2.0:1788684234.172526:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 110 00000100:00100000:2.0:1788684234.172535:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+42:11360:x1875571073145984:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684234.172560:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684234.172580:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acaf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ba3 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.172686:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acafb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.172699:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acafb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.172710:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acafb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684234.172736:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788684234.172839:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acaf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ba3 expref: 45 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.172856:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acafb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ba3 expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.172865:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6647580300) 00010000:00010000:2.0:1788684234.172868:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788684234.172871:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5400, rc 0) 00000100:00100000:0.0:1788684234.173640:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684234.173759:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073146112 00000100:00100000:3.0:1788684234.173770:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073146112 00000100:00100000:3.0:1788684234.173990:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:3.0:1788684234.174017:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+45:2392:x1875571073146112:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684234.174036:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684234.174063:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54acae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b9c expref: 45 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.174088:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6647580300) 00010000:00010000:3.0:1788684234.174094:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684234.174109:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:11360:x1875571073145984:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1569us (1936us total) trans 4294967382 rc 0/0 00000100:00100000:2.0:1788684234.174131:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 110 00000100:00100000:3.0:1788684234.174159:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:2392:x1875571073146112:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 141us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684234.174169:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:3.0:1788684234.184018:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.184352:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073146240 00000100:00100000:0.0:1788684234.184361:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073146240 00000100:00100000:0.0:1788684234.184556:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:0.0:1788684234.184566:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073146240:12345-192.168.206.44@tcp:1:lfs.0 00010000:00010000:0.0:1788684234.184602:0:9991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.184621:0:9991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.184630:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788684234.184634:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788684234.184638:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.184693:0:9991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.184708:0:9991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 8 pid: 8411 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684234.184722:0:9991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbf6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9991:1875571085800064:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684234.184809:0:9991:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646fc00 going to sleep for 11 seconds 00000100:00080000:3.0:1788684234.186277:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684234.188226:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684234.188329:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073146368 00000100:00100000:2.0:1788684234.188338:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073146368 00002000:00100000:2.0:1788684234.188424:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d677fbc1880 x1875571073146368/t0(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:155/0 lens 504/0 e 0 to 0 dl 1788684245 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788684234.188435:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d677fbc1880 with x1875571073146368 ext(0->8) 00010000:00010000:2.0:1788684234.188445:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 9 pid: 8411 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.188461:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 9 pid: 8411 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684234.188469:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d677fbc1880 00000100:00100000:2.0:1788684234.188492:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:2.0:1788684234.188525:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2393:x1875571073146368:12345-192.168.206.44@tcp:4:lfs.0 00000100:00100000:0.0:1788684234.190079:0:9991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbf6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9991:1875571085800064:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684234.190106:0:9991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684234.190556:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:2393:x1875571073146368:12345-192.168.206.44@tcp:4:lfs.0 Request processed in 2040us (2336us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788684234.190568:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00002000:00100000:2.0:1788684234.190579:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8d677fbc1880 x1875571073146368/t4294967303(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:155/0 lens 504/448 e 0 to 0 dl 1788684245 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788684234.190587:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d677fbc1880 with x1875571073146368 ext(0->8) 00010000:00010000:2.0:1788684234.190595:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 11 pid: 8411 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.190609:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 11 pid: 8411 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684234.190616:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d677fbc1880 00000001:00080000:0.0:1788684234.194835:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788684234.194853:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788684234.195580:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684234.195853:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073146496 00000100:00100000:3.0:1788684234.195863:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073146496 00010000:00010000:3.0:1788684234.196121:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 7 pid: 8411 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684234.196211:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:3.0:1788684234.196221:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073146496:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684234.196237:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788684234.196262:0:9510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788684234.196265:0:9510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788684234 00002000:00010000:3.0:1788684234.196268:0:9510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788684234 00002000:00010000:3.0:1788684234.196270:0:9510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788684234 00002000:00010000:3.0:1788684234.196272:0:9510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788684234.196278:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 7 pid: 8411 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.196315:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 7 pid: 8411 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.196340:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000983cef27/0x44bac02bd54acaca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b8e expref: 7 pid: 8411 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.196357:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684234.196361:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684234.196424:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.196435:0:9510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.196463:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684234.196525:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073146496:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 293us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684234.196533:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00010000:00010000:1.0:1788684234.196792:0:9991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.196802:0:9991:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.196822:0:9991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.196830:0:9991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.196838:0:9991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.196845:0:9991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684234.196850:0:9991:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.196859:0:9991:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.196871:0:9991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.196899:0:9991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54acb09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684234.196968:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073146240:12345-192.168.206.44@tcp:1:lfs.0 Request processed in 12403us (12957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684234.196975:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:1.0:1788684234.199860:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.200219:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073146752 00000100:00100000:0.0:1788684234.200230:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073146752 00000100:00100000:0.0:1788684234.200727:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:0.0:1788684234.200739:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749556c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:11360:x1875571073146752:12345-192.168.206.44@tcp:35:lfs.0 00000004:00010000:0.0:1788684234.200801:0:6501:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acafb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ba3 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788684234.201273:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788684234.201321:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1788684234.201714:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:0.0:1788684234.201751:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.201766:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b80 expref: 47 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.201774:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.201804:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b80 expref: 47 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.201817:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b80 expref: 47 pid: 12443 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684234.201840:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbf6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1875571085800192:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684234.202259:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684234.206133:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.206265:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbf6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1875571085800192:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684234.206293:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684234.206794:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073146880 00000100:00100000:3.0:1788684234.206802:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073146880 00010000:00010000:3.0:1788684234.206835:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b80 expref: 48 pid: 12443 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684234.206911:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:3.0:1788684234.206921:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+48:2393:x1875571073146880:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684234.206951:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684234.206958:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b80 expref: 48 pid: 12443 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.206970:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b80 expref: 48 pid: 12443 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.206991:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acab5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b80 expref: 48 pid: 12443 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.207015:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6647580300) 00010000:00010000:3.0:1788684234.207020:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.207028:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.207037:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.207068:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684234.207138:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+47:2393:x1875571073146880:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 218us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684234.207146:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00010000:00010000:1.0:1788684234.207307:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.207315:0:6501:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788684234.207456:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:1.0:1788684234.207562:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788684234.207640:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085800320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788684234.207700:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684234.207728:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684234.207746:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085800320 00000100:00100000:1.0:1788684234.207750:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085800320 00000100:00100000:1.0:1788684234.207778:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788684234.207784:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6501:x1875571085800320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788684234.207850:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6501:x1875571085800320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684234.207857:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788684234.207898:0:6501:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1788684234.207903:0:6501:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1788684234.207922:0:6501:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d677fa6aa00, transno 4294967302 00000100:00100000:1.0:1788684234.207935:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085800320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788684234.208024:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:1.0:1788684234.208058:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085800448:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788684234.208746:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684234.208767:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398900 going to sleep for 11 seconds 00000100:00100000:1.0:1788684234.208851:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085800448 00000100:00100000:1.0:1788684234.208856:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085800448 00000100:00100000:1.0:1788684234.208884:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788684234.208891:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1875571085800448:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788684234.208998:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6501:x1875571085800448:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 106us (252us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788684234.209361:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788684234.209576:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085800448:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788684234.209621:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788684234.209666:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.209675:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.209683:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.209689:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684234.209693:0:6501:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.209712:0:6501:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.209726:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6647580300) 00010000:00010000:1.0:1788684234.209729:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788684234.209734:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684234.209741:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb10 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788684234.209831:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788684234.209883:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788684234.209894:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315203527481ns, next at 316203525431ns, rc = 0 00000001:00080000:1.0:1788684234.209900:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:1.0:1788684234.209919:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6647580300) 00010000:00010000:1.0:1788684234.209922:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788684234.209929:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acafb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ba3 expref: 51 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684234.210638:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749556c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+50:11360:x1875571073146752:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 9899us (10783us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788684234.210657:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000020:00080000:1.0:1788684234.210662:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788684234.217186:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.217274:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073147008 00000100:00100000:0.0:1788684234.217283:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073147008 00000100:00100000:0.0:1788684234.217611:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 111 00000100:00100000:0.0:1788684234.217621:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+50:11360:x1875571073147008:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684234.217644:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684234.217677:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acb17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3baa expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.217732:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acb17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3baa expref: 51 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.217746:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acb17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3baa expref: 51 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.217764:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:0.0:1788684234.217768:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788684234.217771:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891800, rc 0) 00000100:00100000:0.0:1788684234.217874:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+51:11360:x1875571073147008:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 245us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684234.218540:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 111 00000100:00100000:2.0:1788684234.224909:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684234.225034:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073147264 00000100:00100000:1.0:1788684234.225043:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073147264 00000100:00100000:1.0:1788684234.225103:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:1.0:1788684234.225113:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+51:11360:x1875571073147264:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684234.225348:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:11360:x1875571073147264:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 234us (446us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788684234.225357:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:1.0:1788684234.311771:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684234.311953:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073147392 00000100:00100000:3.0:1788684234.311965:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073147392 00000100:00100000:3.0:1788684234.312321:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 112 00000100:00100000:3.0:1788684234.312333:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:11370:x1875571073147392:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:3.0:1788684234.312458:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312475:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312487:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312499:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312507:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312514:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312583:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312591:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312597:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788684234.312660:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312674:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312697:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312704:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312713:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684234.312718:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312726:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312737:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:3.0:1788684234.312740:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684234.312747:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312753:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54acb1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312767:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312773:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312779:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312784:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684234.312795:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312802:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312810:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869200) 00010000:00010000:3.0:1788684234.312813:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684234.312816:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312823:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acb25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312844:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312850:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312855:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312860:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684234.312863:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312869:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312876:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:3.0:1788684234.312879:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684234.312888:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684234.312894:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acb2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684234.313088:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:11370:x1875571073147392:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 757us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684234.313097:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 112 00000100:00100000:2.0:1788684234.344712:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.344796:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073147648 00000100:00100000:0.0:1788684234.344806:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073147648 00000100:00100000:0.0:1788684234.344864:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 113 00000100:00100000:0.0:1788684234.344874:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:11373:x1875571073147648:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684234.344893:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684234.344914:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acb33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bb1 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.344988:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345003:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345014:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345025:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345033:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345040:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345165:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acb48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345201:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acb48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345208:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acb48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684234.345219:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788684234.345289:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345297:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345304:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345310:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684234.345315:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345323:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345336:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684234.345339:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684234.345343:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345349:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345362:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345586:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345592:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345597:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684234.345600:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345605:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345615:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869200) 00010000:00010000:0.0:1788684234.345617:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684234.345620:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345625:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345673:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acb33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bb1 expref: 55 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345688:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acb48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bb1 expref: 54 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.345695:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:0.0:1788684234.345698:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684234.345706:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890400, rc 0) 00000100:00100000:0.0:1788684234.345773:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:11373:x1875571073147648:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 900us (1070us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788684234.345781:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 113 00000100:00100000:0.0:1788684234.356695:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684234.356977:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073147776 00000100:00100000:2.0:1788684234.356986:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073147776 00000100:00100000:2.0:1788684234.357045:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00100000:2.0:1788684234.357054:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:11373:x1875571073147776:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:2.0:1788684234.357128:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.357161:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.357173:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.357342:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.357350:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.357356:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.357363:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684234.357395:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.357403:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.357415:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684234.357418:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788684234.357423:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.357429:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684234.357592:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:11373:x1875571073147776:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 537us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684234.357607:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00100000:1.0:1788684234.362602:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684234.363047:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073148032 00000100:00100000:3.0:1788684234.363057:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073148032 00000100:00100000:3.0:1788684234.363110:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:3.0:1788684234.363119:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:11373:x1875571073148032:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1788684234.363734:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+55:11373:x1875571073148032:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 612us (1730us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788684234.363742:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:3.0:1788684234.365488:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684234.365510:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085800576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684234.365635:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684234.365757:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085800576 00000100:00100000:3.0:1788684234.365764:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085800576 00000100:00100000:3.0:1788684234.365821:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788684234.365830:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085800576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788684234.365857:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684234.365902:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085800576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684234.365910:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788684234.365953:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085800576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788684234.365987:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684234.366016:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085800704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684234.366046:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684234.366143:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085800704 00000100:00100000:3.0:1788684234.366147:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085800704 00000100:00100000:3.0:1788684234.366181:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788684234.366318:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085800704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788684234.366346:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684234.366496:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085800704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 308us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684234.366502:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788684234.366533:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684234.366546:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085800832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684234.366580:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684234.366602:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085800832 00000100:00100000:1.0:1788684234.366607:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085800832 00000100:00100000:0.0:1788684234.366623:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085800704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684234.366634:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788684234.366640:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085800832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684234.366674:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684234.366717:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085800832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684234.366723:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788684234.366775:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085800832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684234.480312:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.480698:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073148288 00000100:00100000:0.0:1788684234.480708:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073148288 00000100:00100000:0.0:1788684234.480768:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00100000:0.0:1788684234.480778:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+55:11383:x1875571073148288:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1788684234.480800:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684234.480804:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788684234.480828:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acad8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b95 expref: 55 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.480846:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684234.480851:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788684234.480865:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb5d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bb8 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.482547:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.482586:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.482599:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684234.482623:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788684234.482755:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54acb5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bb8 expref: 57 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.482772:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bb8 expref: 56 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.482780:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:0.0:1788684234.482783:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684234.482786:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891a00, rc 0) 00000100:00100000:0.0:1788684234.482841:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+56:11383:x1875571073148288:12345-192.168.206.44@tcp:101:bash.0 Request processed in 2065us (2537us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788684234.482850:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00100000:0.0:1788684234.486921:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684234.487150:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073148416 00000100:00100000:2.0:1788684234.487279:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073148416 00000100:00100000:2.0:1788684234.487333:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 116 00000100:00100000:2.0:1788684234.487342:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+56:11383:x1875571073148416:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684234.487363:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684234.487415:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bbf expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.487449:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.487461:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.487473:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.487576:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bbf expref: 58 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.487594:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bbf expref: 57 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.487604:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684234.487607:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788684234.487610:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4400, rc 0) 00000100:00100000:2.0:1788684234.487670:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:11383:x1875571073148416:12345-192.168.206.44@tcp:101:bash.0 Request processed in 329us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684234.487677:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 116 00000100:00100000:1.0:1788684234.493687:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684234.493730:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.493769:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073148544 00000100:00100000:2.0:1788684234.493778:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073148800 00000100:00100000:0.0:1788684234.493779:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073148544 00000100:00100000:2.0:1788684234.493785:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073148800 00000100:00100000:0.0:1788684234.493838:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:0.0:1788684234.493851:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:2393:x1875571073148544:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684234.493865:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684234.493888:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acb64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bb8 expref: 58 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684234.493911:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 117 00010000:00010000:0.0:1788684234.493923:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00000100:00100000:2.0:1788684234.493928:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:11383:x1875571073148800:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:0.0:1788684234.493930:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684234.493974:0:7963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684234.493991:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acb48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bb1 expref: 57 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684234.493995:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:2393:x1875571073148544:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 145us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684234.494011:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00010000:00010000:2.0:1788684234.494015:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684234.494020:0:7963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684234.494529:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.494544:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.494554:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684234.494599:0:7963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:2.0:1788684234.494623:0:7963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001479c0bb reply state 000000001fbf80e6 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.494636:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.494643:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684234.494666:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684234.494670:0:7963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684234.494745:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:11383:x1875571073148800:12345-192.168.206.44@tcp:36:bash.0 Request processed in 823us (1014us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788684234.494752:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 117 00000020:00080000:2.0:1788684234.494756:0:7963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788684234.499165:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684234.499623:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073148928 00000100:00100000:2.0:1788684234.499633:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073148928 00000100:00100000:2.0:1788684234.499699:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:2.0:1788684234.499709:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:11383:x1875571073148928:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684234.499732:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684234.499751:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acb87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bc6 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.499837:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.499853:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.500534:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684234.500577:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788684234.500581:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684234.500601:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.500631:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acb87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bc6 expref: 60 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.500679:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bc6 expref: 59 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.500688:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684234.500691:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684234.500694:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5e00, rc 0) 00000100:00100000:2.0:1788684234.500759:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:11383:x1875571073148928:12345-192.168.206.44@tcp:101:bash.0 Request processed in 1052us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684234.500768:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:1.0:1788684234.505946:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684234.506149:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073149184 00000100:00100000:2.0:1788684234.506159:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073149184 00000100:00100000:2.0:1788684234.506225:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:2.0:1788684234.506234:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:11383:x1875571073149184:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:2.0:1788684234.506577:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:11383:x1875571073149184:12345-192.168.206.44@tcp:35:bash.0 Request processed in 342us (639us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788684234.506585:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:0.0:1788684234.562675:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684234.562773:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073149312 00000100:00100000:2.0:1788684234.562782:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073149312 00000100:00100000:2.0:1788684234.562839:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:2.0:1788684234.562849:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:11389:x1875571073149312:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684234.562870:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684234.562891:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acb95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bcd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.563114:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.563143:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.563153:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684234.563264:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788684234.563268:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684234.563287:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.563311:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acb95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bcd expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.563329:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bcd expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.563339:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684234.563342:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684234.563346:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4200, rc 0) 00000100:00100000:2.0:1788684234.563822:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:11389:x1875571073149312:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 972us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684234.563830:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:1.0:1788684234.581885:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.582478:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073149440 00000100:00100000:0.0:1788684234.582488:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073149440 00000100:00100000:0.0:1788684234.582553:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:0.0:1788684234.582563:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:11389:x1875571073149440:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684234.582582:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684234.582601:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acba3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bd4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.582995:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583011:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583022:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583032:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583040:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583063:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583131:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583140:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583147:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684234.583187:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788684234.583191:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684234.583219:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583231:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583239:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583245:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583251:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583258:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684234.583262:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583277:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583288:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684234.583291:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684234.583295:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583301:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583315:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583321:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583327:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583332:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684234.583334:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583340:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583346:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869200) 00010000:00010000:0.0:1788684234.583349:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684234.583351:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583437:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583465:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acba3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583478:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 62 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.583486:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:0.0:1788684234.583488:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684234.583491:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891600, rc 0) 00000100:00100000:0.0:1788684234.583559:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11389:x1875571073149440:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 997us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684234.583566:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:1.0:1788684234.588420:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.588560:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073149696 00000100:00100000:0.0:1788684234.588570:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073149696 00000100:00100000:0.0:1788684234.588615:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:0.0:1788684234.588624:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11389:x1875571073149696:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684234.588643:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684234.588672:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bdb expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.588787:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.588803:0:13784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bc6 expref: 63 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.588818:0:13784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.588827:0:13784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.588856:0:13784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.588869:0:13784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 63 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684234.588883:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13784:1875571085800960:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684234.588982:0:13784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bc6 expref: 63 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.588990:0:13784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bc6 expref: 63 pid: 6499 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684234.588999:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbf4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13784:1875571085801088:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684234.589022:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684234.599547:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684234.599618:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.599701:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073149824 00000100:00100000:0.0:1788684234.599710:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073149824 00010000:00010000:0.0:1788684234.599750:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 64 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684234.599803:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073149952 00000100:00100000:0.0:1788684234.599807:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073149952 00010000:00010000:0.0:1788684234.599821:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bc6 expref: 65 pid: 6499 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684234.599840:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:0.0:1788684234.599849:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:2391:x1875571073149824:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684234.599863:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684234.599870:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 65 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.599882:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 65 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.599903:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:0.0:1788684234.599908:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.599916:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.599922:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684234.599962:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:2391:x1875571073149824:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 114us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684234.599970:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:0.0:1788684234.599987:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:0.0:1788684234.599993:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:2393:x1875571073149952:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684234.600006:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684234.600012:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bc6 expref: 64 pid: 6499 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.600022:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bc6 expref: 64 pid: 6499 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.600034:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:0.0:1788684234.600037:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.600046:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.600054:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.600070:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684234.600088:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:2393:x1875571073149952:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 95us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684234.600094:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 71 00010000:00010000:2.0:1788684234.600812:0:13784:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.44@tcp) returned -22 from blocking AST (req@000000000747b1f2 x1875571085800960) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 63 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.600829:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acbb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bd4 expref: 63 pid: 6497 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684234.600857:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6775ef4380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13784:1875571085800960:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684234.600886:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acb8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bc6 expref: 62 pid: 6499 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684234.600897:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbf4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13784:1875571085801088:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684234.600915:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684234.600922:0:13784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.600932:0:13784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.600938:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684234.600956:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788684234.601066:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bdb expref: 63 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.601081:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bdb expref: 62 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.601088:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684234.601091:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788684234.601094:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890800, rc 0) 00000100:00100000:2.0:1788684234.601147:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11389:x1875571073149696:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 12523us (12735us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788684234.601161:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:1.0:1788684234.610244:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.610357:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073150208 00000100:00100000:0.0:1788684234.610410:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073150208 00000100:00100000:0.0:1788684234.610471:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:0.0:1788684234.610482:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11389:x1875571073150208:12345-192.168.206.44@tcp:103:lfs.0 00010000:00010000:0.0:1788684234.610509:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684234.610749:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acb17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3baa expref: 62 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.610779:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:0.0:1788684234.610784:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684234.610840:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:11389:x1875571073150208:12345-192.168.206.44@tcp:103:lfs.0 Request processed in 360us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684234.610851:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:1.0:1788684234.614949:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684234.615022:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073150336 00000100:00100000:0.0:1788684234.615032:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073150336 00000100:00100000:0.0:1788684234.615091:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:0.0:1788684234.615101:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:11389:x1875571073150336:12345-192.168.206.44@tcp:58:lfs.0 00010000:00010000:0.0:1788684234.615214:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.615232:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684234.615242:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684234.615323:0:12443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788684234.615428:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:11389:x1875571073150336:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 328us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684234.615436:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:1.0:1788684234.620492:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684234.620698:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073150464 00000100:00100000:2.0:1788684234.620709:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073150464 00000100:00100000:2.0:1788684234.620767:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:2.0:1788684234.620777:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:11389:x1875571073150464:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684234.620795:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684234.620814:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3be2 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.620867:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.620888:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be2 expref: 62 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.620907:0:7963:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.620921:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be2 expref: 62 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.620935:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684234.620938:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684234.620942:0:7963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be2 expref: 62 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684234.620949:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5e00, rc 0) 00000100:00100000:2.0:1788684234.621012:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11389:x1875571073150464:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 235us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684234.621019:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:0.0:1788684234.879227:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085801216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684234.879301:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684234.880494:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085801216 00000100:00100000:1.0:1788684234.880506:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085801216 00000100:00100000:1.0:1788684234.880568:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788684234.880578:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085801216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684234.880609:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788684234.880688:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085801216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684234.880696:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788684234.881733:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085801216:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788684235.006805:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788684235.006814:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788684235.006838:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788684235.006846:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788684235.006985:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085801344:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788684235.007084:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664186b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788684235.013976:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647566d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085801344:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788684235.016766:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.016876:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073150592 00000100:00100000:2.0:1788684235.016886:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073150592 00000100:00100000:2.0:1788684235.016952:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:2.0:1788684235.016962:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11390:x1875571073150592:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788684235.016991:0:6499:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788684235.017106:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11390:x1875571073150592:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 144us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684235.017114:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:1.0:1788684235.024924:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.025011:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073150720 00000100:00100000:0.0:1788684235.025020:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073150720 00000100:00100000:0.0:1788684235.025080:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:0.0:1788684235.025102:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11390:x1875571073150720:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788684235.025175:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025192:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025205:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025222:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025229:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025236:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025260:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025268:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025275:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684235.025336:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788684235.025340:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684235.025352:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025409:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025416:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025423:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025429:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684235.025433:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025441:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025454:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:0.0:1788684235.025457:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684235.025462:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025468:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acbe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025481:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025487:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025504:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025523:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684235.025527:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025533:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025542:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8d6641869700) 00010000:00010000:0.0:1788684235.025555:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684235.025559:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025565:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acbe9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025579:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025585:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025590:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025596:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684235.025599:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025605:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025625:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:0.0:1788684235.025627:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684235.025630:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.025636:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acbf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684235.025721:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11390:x1875571073150720:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 620us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684235.025729:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:1.0:1788684235.030129:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.030225:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073150976 00000100:00100000:2.0:1788684235.030235:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073150976 00000100:00100000:2.0:1788684235.030288:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:2.0:1788684235.030297:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:11390:x1875571073150976:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684235.030317:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684235.030338:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acbf7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3be9 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030481:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030495:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030518:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684235.030543:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788684235.030625:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030633:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030639:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030656:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684235.030660:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030668:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030681:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684235.030683:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788684235.030687:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030693:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acbfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030729:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acbf7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be9 expref: 64 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030740:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:2.0:1788684235.030742:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788684235.030751:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acbf7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be9 expref: 64 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.030762:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5800, rc 0) 00000100:00100000:2.0:1788684235.030813:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:11390:x1875571073150976:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 517us (693us total) trans 4294967400 rc 301/301 00000100:00100000:2.0:1788684235.030821:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:1.0:1788684235.045433:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.045728:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073151104 00000100:00100000:2.0:1788684235.045738:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073151104 00000100:00100000:2.0:1788684235.045793:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:2.0:1788684235.045801:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:11390:x1875571073151104:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788684235.045834:0:6499:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788684235.045946:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:11390:x1875571073151104:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 145us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684235.045954:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:1.0:1788684235.054044:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.054140:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073151360 00000100:00100000:0.0:1788684235.054150:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073151360 00000100:00100000:0.0:1788684235.054208:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:0.0:1788684235.054217:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:11390:x1875571073151360:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684235.054236:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684235.054239:0:12443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788684235.054262:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acb9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bcd expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.054279:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:0.0:1788684235.054284:0:12443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788684235.054295:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acc0c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bf0 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788684235.054903:0:12443:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788684235.055046:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acc13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.055074:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acc13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.055084:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acc13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.055138:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acc0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf0 expref: 65 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.055154:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acc13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf0 expref: 64 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.055162:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6641869700) 00010000:00010000:0.0:1788684235.055165:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684235.055168:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891000, rc 0) 00000100:00100000:0.0:1788684235.055220:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:11390:x1875571073151360:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1003us (1184us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788684235.055227:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:1.0:1788684235.063487:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.063553:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073151616 00000100:00100000:2.0:1788684235.063562:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073151616 00000100:00100000:2.0:1788684235.063619:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:2.0:1788684235.063629:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:11390:x1875571073151616:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788684235.063696:0:7963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684235.063725:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54acc13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf0 expref: 64 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063745:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6641869700) 00010000:00010000:2.0:1788684235.063756:0:7963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684235.063777:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063808:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063818:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063834:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063841:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063847:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063896:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063902:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063908:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063914:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684235.063919:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063926:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063934:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684235.063942:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684235.063947:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063952:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acc21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063963:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063968:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063974:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063979:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684235.063982:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063988:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.063996:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xdf8a6ef5 (ffff8d6647575700) 00010000:00010000:2.0:1788684235.063999:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684235.064002:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.064007:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc28 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdf8a6ef5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684235.064104:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:11390:x1875571073151616:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 476us (640us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788684235.064118:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:1.0:1788684235.073358:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.073525:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073151744 00000100:00100000:2.0:1788684235.073534:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073151744 00000100:00100000:2.0:1788684235.073586:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:2.0:1788684235.073595:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:11390:x1875571073151744:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684235.073614:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684235.073635:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bf7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.073680:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.073693:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.073703:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.073813:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf7 expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.073831:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf7 expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.073839:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:2.0:1788684235.073842:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788684235.073845:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5200, rc 0) 00000100:00100000:2.0:1788684235.073906:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:11390:x1875571073151744:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 312us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684235.073920:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:1.0:1788684235.082325:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.084257:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073152000 00000100:00100000:2.0:1788684235.084271:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073152000 00000100:00100000:2.0:1788684235.084341:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:2.0:1788684235.084351:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:11390:x1875571073152000:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788684235.084515:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.084532:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.084543:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788684235.084708:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788684235.084718:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 316078351402ns, next at 317078348845ns, rc = 0 00000004:00010000:2.0:1788684235.084765:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d46d8ad2 reply state 00000000004914a6 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.084777:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.084785:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:2.0:1788684235.084788:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788684235.084792:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684235.084882:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:11390:x1875571073152000:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 531us (2565us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788684235.084890:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:1.0:1788684235.094847:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.094943:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073152128 00000100:00100000:2.0:1788684235.094964:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073152128 00000100:00100000:2.0:1788684235.095085:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:2.0:1788684235.095095:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:11390:x1875571073152128:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684235.095118:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684235.095139:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3bfe expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.095195:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bfe expref: 67 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.095209:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bfe expref: 67 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.095225:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:2.0:1788684235.095228:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684235.095232:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5400, rc 0) 00000100:00100000:2.0:1788684235.095298:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:11390:x1875571073152128:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 204us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684235.095305:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:1.0:1788684235.103952:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.104060:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073152256 00000100:00100000:2.0:1788684235.104070:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073152256 00000100:00100000:2.0:1788684235.104143:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:2.0:1788684235.104154:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2393:x1875571073152256:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788684235.104424:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2393:x1875571073152256:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 271us (480us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788684235.104431:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00080000:3.0:1788684235.104741:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684235.108597:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684235.109486:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073152512 00000100:00100000:3.0:1788684235.109507:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073152512 00000100:00100000:3.0:1788684235.109608:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:3.0:1788684235.109622:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:11390:x1875571073152512:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788684235.109968:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+68:11390:x1875571073152512:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 348us (1378us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788684235.109976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:1.0:1788684235.113097:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.113258:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073152768 00000100:00100000:2.0:1788684235.113290:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073152768 00000100:00100000:2.0:1788684235.113407:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:2.0:1788684235.113419:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+68:11390:x1875571073152768:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788684235.113564:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+68:11390:x1875571073152768:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 148us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684235.113573:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:1.0:1788684235.124887:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.125847:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073152896 00000100:00100000:0.0:1788684235.125915:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073152896 00000100:00100000:0.0:1788684235.126044:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:0.0:1788684235.126056:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+68:11390:x1875571073152896:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684235.126096:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684235.126126:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acc4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c05 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.126211:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acc52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.126246:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acc52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.126259:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acc52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684235.126452:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684235.126477:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acc52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.126586:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acc4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c05 expref: 70 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.126612:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acc52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c05 expref: 69 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.126624:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:0.0:1788684235.126628:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788684235.126632:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891800, rc 0) 00000100:00100000:0.0:1788684235.126793:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+69:11390:x1875571073152896:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 738us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684235.126811:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:1.0:1788684235.134721:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.134810:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073153024 00000100:00100000:0.0:1788684235.134824:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073153024 00000100:00100000:0.0:1788684235.134900:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:0.0:1788684235.134912:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2393:x1875571073153024:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684235.134935:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684235.134975:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c0c expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684235.135006:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d27cb, blocks: 0x0 00010000:00010000:0.0:1788684235.135029:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1788684235.135034:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684235.135045:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c0c expref: 10 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.135182:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c0c expref: 10 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.135200:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891600, rc 0) 00000100:00100000:0.0:1788684235.135276:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:2393:x1875571073153024:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 367us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684235.135284:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:1.0:1788684235.141206:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.141492:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073153280 00000100:00100000:0.0:1788684235.141505:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073153280 00000100:00100000:0.0:1788684235.141582:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 135 00000100:00100000:0.0:1788684235.141592:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+69:11390:x1875571073153280:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788684235.141795:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+69:11390:x1875571073153280:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 204us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684235.141814:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 135 00000100:00100000:2.0:1788684235.146143:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.146353:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073153408 00000100:00100000:0.0:1788684235.146468:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073153408 00000100:00100000:1.0:1788684235.146742:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:1.0:1788684235.146755:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:11390:x1875571073153408:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684235.146798:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684235.146872:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c13 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.146912:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c0c expref: 11 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.146922:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684235.146927:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684235.146934:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.146978:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c0c expref: 11 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.146995:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c0c expref: 11 pid: 8412 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684235.147011:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664776d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875571085801472:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684235.149072:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67453983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684235.152595:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664776d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875571085801472:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684235.152618:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.152689:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073153536 00000100:00100000:0.0:1788684235.152697:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073153536 00010000:00010000:0.0:1788684235.152988:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c0c expref: 12 pid: 8412 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684235.153036:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:0.0:1788684235.153047:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:2392:x1875571073153536:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684235.153064:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684235.153091:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c0c expref: 12 pid: 8412 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.153106:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c0c expref: 12 pid: 8412 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.153133:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038396e1c/0x44bac02bd54acc59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c0c expref: 12 pid: 8412 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.153153:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684235.153157:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684235.153167:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.153178:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.153268:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.153285:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0800, rc 0) 00000100:00100000:2.0:1788684235.153356:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:11390:x1875571073153408:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 6604us (7297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684235.153403:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00010000:00010000:0.0:1788684235.154403:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 10 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684235.154440:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6483:1875571085801600:192.168.206.44@tcp:105: 00000100:00100000:0.0:1788684235.154524:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788684235.161480:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6483:1875571085801600:192.168.206.44@tcp:105: 00010000:00010000:0.0:1788684235.161515:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684235.161578:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:2392:x1875571073153536:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 8531us (8958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684235.161592:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:1.0:1788684235.164019:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.164407:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073153664 00000100:00100000:0.0:1788684235.164419:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073153664 00002000:00100000:0.0:1788684235.164483:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d664776d180 x1875571073153664/t0(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:156/0 lens 504/0 e 0 to 0 dl 1788684246 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788684235.164494:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d664776d180 with x1875571073153664 ext(0->12) 00002000:00010000:0.0:1788684235.164501:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d664776d180 00000100:00100000:0.0:1788684235.164541:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:0.0:1788684235.164552:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:2393:x1875571073153664:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788684235.169671:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:2393:x1875571073153664:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 Request processed in 4902us (5447us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788684235.169690:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00002000:00100000:1.0:1788684235.169795:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8d664776d180 x1875571073153664/t4294967309(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:156/0 lens 504/448 e 0 to 0 dl 1788684246 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788684235.169967:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d664776d180 with x1875571073153664 ext(0->12) 00002000:00010000:1.0:1788684235.169975:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d664776d180 00000100:00100000:1.0:1788684235.178191:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.178349:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073153792 00000100:00100000:0.0:1788684235.178493:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073153792 00000100:00100000:2.0:1788684235.178844:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 136 00000100:00100000:2.0:1788684235.178857:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+69:11390:x1875571073153792:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788684235.181169:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:0.0:1788684235.181187:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788684235.181230:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788684235.181247:0:6476:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d6745398a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788684235.181252:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d677e3fea00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d6745398240 00000020:00080000:0.0:1788684235.181255:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d677e3fe100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d6647a4ce00 00000004:00080000:0.0:1788684235.181293:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788684235.181319:0:6476:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d674890b480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788684235.181322:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6647872800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d674890b000 00000020:00080000:0.0:1788684235.181324:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6647872b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d677fbbb600 00000020:00080000:0.0:1788684235.181345:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788684235.181427:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788684235.181511:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684235.181529:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085801728:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788684235.181594:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684235.181637:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085801728 00000100:00100000:0.0:1788684235.181654:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085801728 00000100:00100000:0.0:1788684235.181705:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788684235.181714:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085801728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788684235.181738:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1788684235.181766:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9d27ca, atime: 0x6a9d27ca, ctime: 0x6a9d27ca, blocks: 0x8 00010000:00010000:0.0:1788684235.181776:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.181793:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1788684235.181799:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684235.181806:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.181823:0:8412:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.181849:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.181859:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.181894:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788684235.181911:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684235.181999:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085801728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 285us (403us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788684235.182005:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788684235.182038:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684235.182047:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085801856:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788684235.182072:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684235.182099:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085801856 00000100:00100000:0.0:1788684235.182102:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085801856 00000100:00100000:0.0:1788684235.182128:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684235.182133:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085801856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788684235.182147:0:9991:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1788684235.182160:0:9991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.182174:0:9991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b6b expref: 11 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.182181:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788684235.182190:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788684235.182194:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.182220:0:9991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b6b expref: 11 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.182235:0:9991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b6b expref: 11 pid: 9991 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684235.182247:0:9991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9991:1875571085802112:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684235.182283:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664799dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085801984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788684235.182310:0:9991:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f600 going to sleep for 11 seconds 00010000:00010000:0.0:1788684235.182335:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684235.182341:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.182348:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684235.182353:0:9499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.182362:0:9499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.182405:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.182413:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54acc67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.182441:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684235.182445:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684235.182448:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684235.182468:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684235.182536:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085801984 00000100:00100000:2.0:1788684235.182544:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085801984 00000100:00100000:2.0:1788684235.183040:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788684235.183051:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3626:x1875571085801984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788684235.183195:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788684235.183217:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788684235 00002000:00010000:2.0:1788684235.183220:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788684235.183222:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788684235 -> 1788684235 00002000:00010000:2.0:1788684235.183225:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788684235.183284:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3626:x1875571085801984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (820us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788684235.183292:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788684235.184490:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684235.184502:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788684235.185066:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d664799dc00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788684235.185081:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085801984:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1788684235.185185:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d664842a680/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788684235.185192:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085801728:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788684235.185693:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.185711:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.185720:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.185726:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684235.185731:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684235.185817:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11390:x1875571073153792:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 6957us (7635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684235.185850:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 136 00010000:00010000:1.0:1788684235.186072:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186091:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8d6641869400) 00010000:00010000:1.0:1788684235.186095:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684235.186099:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186106:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ac965 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186137:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186162:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186169:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186174:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684235.186177:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186184:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186193:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684235.186195:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684235.186198:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186204:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54aca0d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186221:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186228:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186234:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186240:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684235.186249:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186255:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186264:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869200) 00010000:00010000:1.0:1788684235.186266:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684235.186269:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186275:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54aca8b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186286:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186292:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186298:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186303:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684235.186306:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186312:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186319:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641869200) 00010000:00010000:1.0:1788684235.186321:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684235.186342:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186348:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acaae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186921:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186930:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186935:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186940:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684235.186944:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186950:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186960:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:1.0:1788684235.186966:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684235.186970:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186976:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acb80 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186990:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.186996:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.187010:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.187014:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684235.187018:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.187023:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.187031:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:1.0:1788684235.187033:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788684235.187036:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.187041:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acc3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684235.187810:0:9991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9991:1875571085802112:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684235.187851:0:9991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684235.193979:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.194597:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.195010:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073154048 00000100:00100000:3.0:1788684235.195011:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073153920 00000100:00100000:3.0:1788684235.195026:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073153920 00000100:00100000:2.0:1788684235.195027:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073154048 00010000:00010000:3.0:1788684235.195089:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b6b expref: 13 pid: 9991 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684235.195119:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:2.0:1788684235.195136:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:2392:x1875571073154048:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788684235.195227:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:3.0:1788684235.195240:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:2393:x1875571073153920:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684235.195256:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684235.195262:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b6b expref: 13 pid: 9991 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.195277:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b6b expref: 13 pid: 9991 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.195300:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ab08c33/0x44bac02bd54aca1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b6b expref: 13 pid: 9991 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.195317:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684235.195321:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684235.195338:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.195349:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.195434:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684235.195491:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:2393:x1875571073153920:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 255us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684235.195499:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 73 00010000:00010000:3.0:1788684235.195870:0:9991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.195882:0:9991:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.195893:0:9991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.195901:0:9991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.195923:0:9991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684235.196133:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684235.196141:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.196150:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684235.196155:0:6485:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.196164:0:6485:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.196193:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.196200:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0d211f1/0x44bac02bd54acc6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.196219:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684235.196220:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684235.196222:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684235.201434:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3623:x1875571085801856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19289us (19350us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788684235.201450:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1788684235.202184:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d664799ce00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788684235.202198:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664799ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085801856:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788684235.203452:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788684235.203659:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1788684235.221331:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073154048:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 26183us (26719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684235.221349:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:0.0:1788684235.237045:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.237234:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073154304 00000100:00100000:2.0:1788684235.237248:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073154304 00000100:00100000:2.0:1788684235.237322:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:2.0:1788684235.237334:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:11390:x1875571073154304:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788684235.237824:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684235.237879:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acc52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c05 expref: 16 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.237903:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:2.0:1788684235.237910:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684235.237950:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.237966:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.237976:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684235.238126:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f22eb155 reply state 0000000087393e7b transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.238140:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.238147:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:2.0:1788684235.238149:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684235.238152:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684235.238290:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:11390:x1875571073154304:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 958us (1260us total) trans 4294967404 rc 0/0 00000100:00100000:2.0:1788684235.238300:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:1.0:1788684235.241735:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.242004:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073154432 00000100:00100000:0.0:1788684235.242016:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073154432 00000100:00100000:0.0:1788684235.242085:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:0.0:1788684235.242097:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073154432:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788684235.242296:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788684235.242301:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788684235 -> 1788684234 00002000:00010000:0.0:1788684235.242303:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788684234 00002000:00010000:0.0:1788684235.242305:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788684235 -> 1788684234 00002000:00010000:0.0:1788684235.242307:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788684235.242431:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2390:x1875571073154432:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 336us (710us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788684235.242439:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:3.0:1788684235.246892:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.255614:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073154688 00000100:00100000:0.0:1788684235.255631:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073154688 00000100:00100000:0.0:1788684235.255843:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:0.0:1788684235.255854:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:11390:x1875571073154688:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788684235.255923:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.255955:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf7 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.255965:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.256002:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf7 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.256016:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf7 expref: 17 pid: 6499 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684235.256030:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648429f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085802240:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684235.256137:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684235.261138:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684235.261398:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073154816 00000100:00100000:1.0:1788684235.261409:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073154816 00010000:00010000:1.0:1788684235.261454:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf7 expref: 18 pid: 6499 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684235.261499:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00100000:1.0:1788684235.261519:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2393:x1875571073154816:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684235.261534:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684235.261542:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf7 expref: 18 pid: 6499 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.261555:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf7 expref: 18 pid: 6499 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.261596:0:9510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:1.0:1788684235.261601:0:9510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.261611:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.261619:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.261638:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684235.261700:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2393:x1875571073154816:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 192us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684235.261708:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 74 00010000:00010000:0.0:1788684235.263768:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54acc36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bf7 expref: 17 pid: 6499 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684235.263795:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648429f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085802240:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684235.263822:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.263975:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.263983:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.264035:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.264042:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.264049:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.264055:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684235.264058:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.264066:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.264080:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:2.0:1788684235.264083:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788684235.264088:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.264094:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54acc7c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684235.264315:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:11390:x1875571073154688:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 Request processed in 8461us (17431us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788684235.264325:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:2.0:1788684235.268128:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684235.268204:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073154944 00000100:00100000:3.0:1788684235.268214:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073154944 00000100:00100000:3.0:1788684235.268267:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:3.0:1788684235.268291:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073154944:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788684235.268333:0:9991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.268353:0:9991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.268361:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684235.268406:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684235.268411:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.268455:0:9991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.268470:0:9991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 7 pid: 8413 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684235.268483:0:9991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9991:1875571085802368:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684235.268811:0:9991:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684235.272124:0:9991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9991:1875571085802368:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684235.272171:0:9991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684235.273322:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684235.273604:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073155072 00000100:00100000:1.0:1788684235.273612:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073155072 00010000:00010000:1.0:1788684235.273661:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 8 pid: 8413 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684235.273696:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 75 00000100:00100000:1.0:1788684235.273705:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2393:x1875571073155072:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684235.273719:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684235.273738:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 8 pid: 8413 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.273751:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 8 pid: 8413 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.273790:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048cc06f6/0x44bac02bd54acc60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c13 expref: 8 pid: 8413 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.273808:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788684235.273812:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788684235.273818:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.273828:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.273857:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684235.273917:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073155072:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 212us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684235.273924:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 75 00010000:00010000:2.0:1788684235.274547:0:9991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.274559:0:9991:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.274580:0:9991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.274589:0:9991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.274597:0:9991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.274604:0:9991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684235.274609:0:9991:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.274618:0:9991:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.274659:0:9991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.274668:0:9991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acc83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684235.274727:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073154944:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 6438us (6608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684235.274736:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:2.0:1788684235.279895:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684235.280005:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073155328 00000100:00100000:3.0:1788684235.280015:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073155328 00000100:00100000:3.0:1788684235.280069:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00100000:3.0:1788684235.280079:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:11390:x1875571073155328:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788684235.280152:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.280185:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bbf expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.280195:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.280237:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bbf expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.280250:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bbf expref: 16 pid: 6498 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684235.280264:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085802496:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684235.280329:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788684235.285008:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085802496:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684235.285038:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684235.288342:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684235.288520:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073155456 00000100:00100000:1.0:1788684235.288529:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073155456 00010000:00010000:1.0:1788684235.288565:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bbf expref: 17 pid: 6498 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684235.288608:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:1.0:1788684235.288618:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:2393:x1875571073155456:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684235.288632:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684235.288639:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bbf expref: 17 pid: 6498 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.288684:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bbf expref: 17 pid: 6498 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.288705:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54acb79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bbf expref: 17 pid: 6498 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.288721:0:9510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:1.0:1788684235.288726:0:9510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be2 expref: 16 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.288736:0:9510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.288744:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.288752:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.288777:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684235.288796:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.288803:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.288985:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.289006:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bfe expref: 17 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.289015:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.289041:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bfe expref: 17 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.289054:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bfe expref: 17 pid: 7963 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684235.289066:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085802624:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684235.291162:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684235.292847:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:2393:x1875571073155456:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 3025us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684235.294065:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:1.0:1788684235.294906:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.294984:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085802624:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684235.295008:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684235.295068:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073155584 00000100:00100000:3.0:1788684235.295075:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073155584 00010000:00010000:3.0:1788684235.295106:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bfe expref: 17 pid: 7963 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684235.295153:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:3.0:1788684235.295162:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:2393:x1875571073155584:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684235.295176:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684235.295183:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bfe expref: 17 pid: 7963 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.295195:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bfe expref: 17 pid: 7963 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.295239:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54acc44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bfe expref: 17 pid: 7963 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.295253:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:3.0:1788684235.295257:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.295265:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.295272:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.295294:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684235.295917:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684235.295927:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684235.296022:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788684235.296148:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1788684235.296183:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788684235.296262:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6499:1875571085802752:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788684235.296313:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684235.296346:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677726c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788684235.296887:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:2393:x1875571073155584:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 1723us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684235.296898:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:0.0:1788684235.299024:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085802752 00000100:00100000:0.0:1788684235.299035:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085802752 00000100:00100000:0.0:1788684235.299291:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788684235.299302:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6499:x1875571085802752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788684235.299883:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6499:x1875571085802752:12345-0@lo:1000:mdt00_002.0 Request processed in 581us (3567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684235.299892:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788684235.300016:0:6499:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788684235.300023:0:6499:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1788684235.300041:0:6499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d664799dc00, transno 4294967310 00000100:00100000:3.0:1788684235.300063:0:6499:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d664799ce00 x1875571085801856/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788684251 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684235.300075:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6499:1875571085802752:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788684235.300224:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:3.0:1788684235.300291:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6499:1875571085802880:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788684235.300332:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684235.300980:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317540 going to sleep for 11 seconds 00000100:00100000:2.0:1788684235.301063:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085802880 00000100:00100000:2.0:1788684235.301069:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085802880 00000100:00100000:2.0:1788684235.301101:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788684235.301109:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6499:x1875571085802880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788684235.301306:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6499:x1875571085802880:12345-0@lo:1000:mdt00_002.0 Request processed in 196us (972us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788684235.301313:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788684235.301411:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6499:1875571085802880:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788684235.301458:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301467:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301474:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301481:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684235.301485:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301493:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301715:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:3.0:1788684235.301719:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788684235.301724:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301732:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54acc91 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301756:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301762:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301769:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301785:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684235.301788:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301794:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301804:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:3.0:1788684235.301806:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788684235.301813:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be2 expref: 19 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301824:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be2 expref: 19 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301833:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be2 expref: 19 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.301931:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be2 expref: 19 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684235.301946:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085803008:192.168.206.44@tcp:105: 00000100:00100000:3.0:1788684235.302010:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317540 going to sleep for 11 seconds 00000100:00100000:0.0:1788684235.306448:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684235.306663:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085803008:192.168.206.44@tcp:105: 00010000:00010000:3.0:1788684235.306689:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306715:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54acbd4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306745:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306757:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306767:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306777:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306783:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306789:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306794:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711ca00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684235.306798:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306805:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306815:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:3.0:1788684235.306818:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684235.306821:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306832:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acc98 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306841:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306847:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306852:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306857:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684235.306859:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306877:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306886:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:3.0:1788684235.306888:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788684235.306891:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.306896:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54acc8a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684235.307029:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11390:x1875571073155328:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 26951us (27142us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788684235.307039:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 139 00000020:00080000:3.0:1788684235.307050:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788684235.307894:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684235.307899:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684235.308464:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788684235.308473:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788684235.309108:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073155712 00000100:00100000:1.0:1788684235.309116:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073155712 00000100:00100000:1.0:1788684235.309171:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:1.0:1788684235.309180:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11389:x1875571073155712:12345-192.168.206.44@tcp:49:lfs.0 00000100:00100000:1.0:1788684235.309304:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11389:x1875571073155712:12345-192.168.206.44@tcp:49:lfs.0 Request processed in 125us (2863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684235.309312:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:0.0:1788684235.314262:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684235.314310:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684235.314399:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073155968 00000100:00100000:2.0:1788684235.314407:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073155968 00000100:00100000:2.0:1788684235.314454:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:2.0:1788684235.314463:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11389:x1875571073155968:12345-192.168.206.44@tcp:58:lfs.0 00000040:00080000:2.0:1788684235.314818:0:12443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788684235.315016:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11389:x1875571073155968:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 552us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684235.315024:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:1.0:1788684235.315100:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073156224 00000100:00100000:1.0:1788684235.315105:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073156224 00000100:00100000:1.0:1788684235.315141:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:1.0:1788684235.315149:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749557850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:11390:x1875571073156224:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788684235.315360:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788684235.315421:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:1.0:1788684235.315452:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.315468:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.315479:0:6501:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.315487:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.315494:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.315500:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.315632:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788684235.315771:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749557850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:11390:x1875571073156224:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 622us (1459us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788684235.315780:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 32 00000020:00080000:1.0:1788684235.315784:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788684235.315879:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684235.315886:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.315893:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684235.315897:0:6486:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.315905:0:6486:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.315918:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:0.0:1788684235.315921:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788684235.315925:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.315931:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acc9f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684235.315953:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684235.315955:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684235.315957:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684235.364272:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684235.364492:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073156352 00000100:00100000:1.0:1788684235.364500:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073156352 00000100:00100000:1.0:1788684235.364620:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:1.0:1788684235.364629:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:11392:x1875571073156352:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684235.364772:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684235.364804:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54acca6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c1a expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.364863:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.364946:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.364957:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.364972:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.364979:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.364985:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.365051:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.365062:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bdb expref: 22 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.365070:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.365101:0:7963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bdb expref: 22 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.365635:0:7963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bdb expref: 22 pid: 13784 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684235.365722:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085803136:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684235.365878:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67453983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684235.369074:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684235.369688:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073156608 00000100:00100000:3.0:1788684235.369697:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073156608 00000100:00100000:3.0:1788684235.369751:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:3.0:1788684235.369762:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:6158:x1875571073156608:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788684235.369984:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:6158:x1875571073156608:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 215us (909us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788684235.369993:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:0.0:1788684235.372459:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684235.372534:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073156736 00000100:00100000:3.0:1788684235.372542:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073156736 00010000:00010000:3.0:1788684235.372574:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bdb expref: 24 pid: 13784 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684235.372610:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:3.0:1788684235.372620:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:2392:x1875571073156736:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684235.372632:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684235.372639:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bdb expref: 24 pid: 13784 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.372788:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bdb expref: 24 pid: 13784 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.372809:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:3.0:1788684235.372815:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.372824:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.372847:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684235.372875:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684235.372923:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:2392:x1875571073156736:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 304us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684235.372930:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 78 00010000:00010000:1.0:1788684235.374350:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54acbc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3bdb expref: 23 pid: 13784 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684235.374388:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085803136:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684235.374413:0:7963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374424:0:7963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374429:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684235.374479:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788684235.374484:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684235.374503:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374582:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374593:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374617:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374623:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374629:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684235.374633:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374712:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374728:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:1.0:1788684235.374731:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684235.374736:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374742:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54accad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374754:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374760:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374766:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374771:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684235.374781:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374788:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374795:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8d6641867a00) 00010000:00010000:1.0:1788684235.374798:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684235.374800:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374806:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0800/0x44bac02bd54accb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374842:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0000/0x44bac02bd54acca6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c1a expref: 23 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374856:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c1a expref: 22 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684235.374864:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:1.0:1788684235.374932:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788684235.374936:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1200, rc 0) 00000100:00100000:1.0:1788684235.375224:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11392:x1875571073156352:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 10595us (10959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684235.375233:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 141 00010000:00010000:0.0:1788684235.390524:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788684236.158731:0:14287:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788684236.158800:0:14287:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788684236.158834:0:14287:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788684236.158840:0:14287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788684236.360227:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788684236.360235:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788684236.360266:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788684236.360273:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788684236.360409:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085803264:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788684236.360494:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684236.369917:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085803264:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788684236.370706:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684236.371024:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073156864 00000100:00100000:3.0:1788684236.371034:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073156864 00000100:00080000:0.0:1788684236.371092:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684236.371111:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:3.0:1788684236.371122:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11404:x1875571073156864:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788684236.371154:0:13784:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788684236.371283:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11404:x1875571073156864:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 162us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684236.371291:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:2.0:1788684236.380133:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684236.380259:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073157120 00000100:00100000:3.0:1788684236.380268:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073157120 00000100:00100000:3.0:1788684236.380318:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:3.0:1788684236.380326:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:11404:x1875571073157120:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684236.380345:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684236.380523:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54accc2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c21 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684236.380621:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54accc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684236.380635:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54accc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684236.380698:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54accc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684236.380709:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788684236.380805:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54accc2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c21 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684236.380822:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54accc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c21 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684236.380831:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:3.0:1788684236.380834:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684236.380837:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711ca00, rc 0) 00000100:00100000:3.0:1788684236.380929:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:11404:x1875571073157120:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 602us (805us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788684236.380937:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:1.0:1788684236.394327:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684236.395297:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073157376 00000100:00100000:2.0:1788684236.395309:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073157376 00000100:00100000:2.0:1788684236.395388:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:2.0:1788684236.395398:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:11404:x1875571073157376:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788684236.395490:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684236.395507:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684236.395518:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684236.395666:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684236.395674:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684236.395680:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684236.395686:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684236.395689:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684236.395697:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684236.395709:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684236.395712:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788684236.395715:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684236.395721:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54accd7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684236.395851:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:11404:x1875571073157376:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 455us (1532us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788684236.395859:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 144 00000040:00080000:1.0:1788684236.397171:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788684236.397178:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788684236.397684:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788684236.397693:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788684236.399020:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684236.399123:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684236.399161:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073157760 00000100:00100000:3.0:1788684236.399170:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073157760 00000100:00100000:3.0:1788684236.399228:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:3.0:1788684236.399281:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:11404:x1875571073157760:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788684236.399298:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073157504 00000100:00100000:0.0:1788684236.399302:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073157504 00000100:00100000:0.0:1788684236.399343:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:0.0:1788684236.399350:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+26:2393:x1875571073157504:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684236.399360:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684236.399403:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54accc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c21 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684236.399420:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:0.0:1788684236.399425:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684236.399524:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+26:11404:x1875571073157760:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 192us (346us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788684236.399533:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:0.0:1788684236.400494:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:2393:x1875571073157504:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 1139us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684236.400504:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00010000:00010000:1.0:1788684236.414356:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684237.440304:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684237.502217:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684237.502255:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684237.502288:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684237.502324:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684237.502349:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684237.502401:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684237.502422:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684237.502460:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073157888 00000100:00100000:0.0:1788684237.502469:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073157888 00000100:00100000:0.0:1788684237.502512:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 379 00000100:00100000:0.0:1788684237.502522:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073157888:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684237.502585:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073157888:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 65us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684237.502593:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 379 00000100:00100000:0.0:1788684237.502627:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073158016 00000100:00100000:0.0:1788684237.502642:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073158016 00000100:00100000:0.0:1788684237.502667:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073158528 00000100:00100000:0.0:1788684237.502670:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073158528 00000100:00100000:0.0:1788684237.502697:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073158144 00000100:00100000:0.0:1788684237.502699:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073158144 00000100:00100000:0.0:1788684237.502712:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073158656 00000100:00100000:0.0:1788684237.502714:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073158656 00000100:00100000:0.0:1788684237.502727:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 271 00000100:00100000:0.0:1788684237.502734:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:2392:x1875571073158016:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684237.502770:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:2392:x1875571073158016:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 36us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684237.502777:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 271 00000100:00100000:0.0:1788684237.502790:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 272 00000100:00100000:0.0:1788684237.502796:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073158528:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684237.502819:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073158528:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684237.502826:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 272 00000100:00100000:0.0:1788684237.502839:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 273 00000100:00100000:0.0:1788684237.502846:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073158144:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684237.502877:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073158144:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 33us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684237.502883:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 273 00000100:00100000:0.0:1788684237.502896:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 274 00000100:00100000:0.0:1788684237.502902:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073158656:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684237.502942:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073158656:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 38us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684237.502949:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 274 00000100:00100000:0.0:1788684237.502969:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073158272 00000100:00100000:0.0:1788684237.502973:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073158272 00000100:00100000:0.0:1788684237.503000:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073158400 00000100:00100000:0.0:1788684237.503003:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073158400 00000100:00100000:0.0:1788684237.503021:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 102 00000100:00100000:0.0:1788684237.503027:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073158272:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684237.503051:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2392:x1875571073158272:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684237.503057:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 102 00000100:00100000:0.0:1788684237.503067:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 103 00000100:00100000:0.0:1788684237.503072:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073158400:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684237.503095:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073158400:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684237.503101:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 103 00000100:00080000:0.0:1788684237.503116:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684237.503120:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684237.503123:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684237.503131:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788684237.938696:0:14339:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788684237.938705:0:14339:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788684237.938735:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788684237.938742:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684238.146052:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684238.146262:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073158912 00000100:00100000:1.0:1788684238.146271:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073158912 00000100:00100000:1.0:1788684238.146347:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 145 00000100:00100000:1.0:1788684238.146358:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:11424:x1875571073158912:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684238.146432:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684238.146502:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54accde lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c28 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684238.146618:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acce5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684238.146657:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acce5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684238.146669:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acce5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684238.146681:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788684238.146786:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0400/0x44bac02bd54accde lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c28 expref: 28 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684238.146803:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acce5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c28 expref: 27 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684238.146812:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:1.0:1788684238.146815:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788684238.146819:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1a00, rc 0) 00000100:00100000:1.0:1788684238.146871:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:11424:x1875571073158912:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 516us (828us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788684238.146878:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 145 00000100:00080000:0.0:1788684238.147254:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684238.156489:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684238.156642:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073159040 00000100:00100000:3.0:1788684238.156652:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073159040 00000100:00100000:3.0:1788684238.156726:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00100000:3.0:1788684238.156736:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:11424:x1875571073159040:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:3.0:1788684238.156803:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684238.156821:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684238.156832:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684238.156863:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684238.156869:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684238.156876:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684238.156881:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684238.156885:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684238.156905:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684238.156916:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:3.0:1788684238.156919:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684238.156924:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684238.156940:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54accf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684238.156998:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:11424:x1875571073159040:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 263us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.157006:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00100000:3.0:1788684238.233284:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684238.233471:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073159168 00000100:00100000:0.0:1788684238.233480:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073159168 00000100:00100000:0.0:1788684238.233540:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:0.0:1788684238.233550:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2392:x1875571073159168:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:0.0:1788684238.233568:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684238.233588:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54accfa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c2f expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684238.233615:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9d27ca, atime: 0x6a9d27ca, ctime: 0x6a9d27ca, blocks: 0x8 00010000:00010000:0.0:1788684238.233646:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1788684238.233651:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684238.233660:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54accfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c2f expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684238.233679:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54accfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c2f expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684238.233693:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891000, rc 0) 00000100:00100000:0.0:1788684238.233757:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073159168:12345-192.168.206.44@tcp:101:cat.0 Request processed in 208us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684238.233765:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:0.0:1788684238.242615:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684238.242777:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073159296 00000100:00100000:2.0:1788684238.242787:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073159296 00002000:00100000:2.0:1788684238.242835:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8d6648429880 x1875571073159296/t0(0) o3->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:159/0 lens 488/0 e 0 to 0 dl 1788684249 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788684238.242859:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6648429880 with x1875571073159296 ext(0->4095) 00002000:00010000:2.0:1788684238.242866:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6648429880 00000100:00100000:2.0:1788684238.242900:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:2.0:1788684238.242910:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073159296:12345-192.168.206.44@tcp:3:cat.0 00000100:00100000:2.0:1788684238.243087:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073159296:12345-192.168.206.44@tcp:3:cat.0 Request processed in 176us (480us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788684238.243095:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00002000:00100000:2.0:1788684238.243102:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8d6648429880 x1875571073159296/t0(0) o3->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:159/0 lens 488/4536 e 0 to 0 dl 1788684249 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788684238.243110:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6648429880 with x1875571073159296 ext(0->4095) 00002000:00010000:2.0:1788684238.243113:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6648429880 00010000:00010000:0.0:1788684238.462233:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684238.973702:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085803520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684238.973792:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684238.973797:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085803392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684238.973837:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684238.973909:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085803520 00000100:00100000:1.0:1788684238.973917:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085803520 00000100:00100000:1.0:1788684238.973973:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085803392 00000100:00100000:1.0:1788684238.973977:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085803392 00000100:00100000:1.0:1788684238.973992:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788684238.974000:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1875571085803520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788684238.974025:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684238.974403:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085803648:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.974437:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.974479:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085803648 00000100:00100000:3.0:1788684238.974483:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085803648 00000100:00100000:3.0:1788684238.974841:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788684238.974853:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085803648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.974893:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085803648:12345-0@lo:400:kworker.0 Request processed in 45us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.974899:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788684238.974950:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085803648:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.974995:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788684238.975003:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085803392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684238.976565:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684238.976675:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085803392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1671us (2835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.976684:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788684238.979885:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684238.979956:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085803392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684238.988048:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085804160:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.988175:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.988217:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085804672:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.988248:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.988273:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788684238.988280:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085804032:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.988320:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.988338:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085804544:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.988358:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.988438:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085804160 00000100:00100000:3.0:1788684238.988446:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085804160 00000100:00100000:3.0:1788684238.988667:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788684238.988677:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085804160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.988733:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085804160:12345-0@lo:400:kworker.0 Request processed in 58us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.988740:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788684238.988761:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085804672 00000100:00100000:3.0:1788684238.988764:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085804672 00000100:00100000:3.0:1788684238.988795:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085804032 00000100:00100000:3.0:1788684238.988798:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085804032 00000100:00100000:3.0:1788684238.988811:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085804544 00000100:00100000:3.0:1788684238.988814:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085804544 00000100:00100000:3.0:1788684238.988833:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788684238.988839:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085804672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.988869:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085804672:12345-0@lo:400:kworker.0 Request processed in 30us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.988875:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788684238.988898:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788684238.988903:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085804032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.988927:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085804032:12345-0@lo:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.988932:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788684238.988941:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788684238.988945:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085804544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.988963:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085804544:12345-0@lo:400:kworker.0 Request processed in 18us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.988968:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:3.0:1788684238.988985:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684238.988989:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684238.989005:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085803776:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989140:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.989158:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085804288:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989175:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.989186:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085804800:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989203:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.989219:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788684238.989225:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085803904:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989241:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.989254:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085804416:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989270:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.989280:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085804928:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989296:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684238.989323:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085804800 00000100:00100000:3.0:1788684238.989326:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085804800 00000100:00100000:3.0:1788684238.989350:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085804928 00000100:00100000:3.0:1788684238.989352:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085804928 00000100:00100000:3.0:1788684238.989582:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788684238.989590:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085804800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989635:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085804800:12345-0@lo:400:kworker.0 Request processed in 46us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.989641:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788684238.989653:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788684238.989660:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3625:x1875571085804928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989683:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3625:x1875571085804928:12345-0@lo:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.989688:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788684238.989708:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085803776 00000100:00100000:3.0:1788684238.989711:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085803776 00000100:00100000:3.0:1788684238.989727:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085804288 00000100:00100000:3.0:1788684238.989729:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085804288 00000100:00100000:3.0:1788684238.989741:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085804416 00000100:00100000:3.0:1788684238.989743:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085804416 00000100:00100000:3.0:1788684238.989753:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788684238.989758:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085803776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989780:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085803776:12345-0@lo:400:kworker.0 Request processed in 23us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.989786:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788684238.989794:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788684238.989798:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085804288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989817:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085804288:12345-0@lo:400:kworker.0 Request processed in 18us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.989827:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788684238.989836:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788684238.989841:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085804416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989862:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085804416:12345-0@lo:400:kworker.0 Request processed in 21us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684238.989867:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:3.0:1788684238.989882:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684238.989884:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684238.989887:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788684238.989910:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648603480 x1875571085804416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684238.989922:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085804416:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989931:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085804928:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989939:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085803776:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989946:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085804288:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989954:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085804800:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989986:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085804032:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.989994:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085804544:0@lo:400:kworker.0 00000100:00100000:3.0:1788684238.990002:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085804160:0@lo:400:kworker.0 00010000:00080000:3.0:1788684238.990011:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648602a00 x1875571085804672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684238.990754:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085804672:0@lo:400:kworker.0 00000100:00100000:1.0:1788684238.991452:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1875571085803520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17450us (17657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684238.991473:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788684238.991524:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085803904 00000100:00100000:1.0:1788684238.991530:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085803904 00000100:00100000:1.0:1788684238.991562:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788684238.991569:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085803904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684238.991657:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085803904:12345-0@lo:400:kworker.0 Request processed in 83us (2409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684238.991664:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788684238.991699:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085803904:0@lo:400:kworker.0 00000100:00100000:0.0:1788684238.993917:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085803520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684239.485515:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684239.485534:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085805056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684239.485660:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684239.485721:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085805056 00000100:00100000:3.0:1788684239.485728:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085805056 00000100:00100000:3.0:1788684239.485766:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788684239.485773:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085805056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788684239.485798:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788684239.485850:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085805056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684239.485857:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788684239.485900:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085805056:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788684239.485973:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684239.486260:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085805184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684239.486289:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684239.486317:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085805184 00000100:00100000:3.0:1788684239.486321:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085805184 00000100:00100000:3.0:1788684239.486363:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788684239.486386:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085805184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684239.486408:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788684239.487749:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085805184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1358us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684239.487760:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788684239.487817:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085805184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684239.492824:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085805312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684239.492886:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684239.492991:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085805312 00000100:00100000:1.0:1788684239.493000:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085805312 00000100:00100000:1.0:1788684239.493050:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788684239.493060:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085805312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684239.493080:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788684239.493123:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085805312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684239.493130:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788684239.493201:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085805312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684239.998168:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684239.998192:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085805440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684239.998262:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684239.998810:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085805440 00000100:00100000:3.0:1788684239.998820:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085805440 00000100:00100000:3.0:1788684239.998872:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788684239.998881:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085805440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684239.998911:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788684239.998981:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085805440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684239.998988:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788684239.999909:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085805440:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788684240.002847:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:2.0:1788684240.512006:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788684240.512018:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788684240.512042:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788684240.512051:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788684240.512399:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788684240.830046:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788684241.036010:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1788684241.036045:0:6476:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d6743ee4000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788684241.036050:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6744dc0300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d6743ee4900 00000020:00080000:2.0:1788684241.036054:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6744dc0b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d6647a4ce00 00000020:00080000:2.0:1788684241.036075:0:6476:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788684241.036088:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788684241.036163:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788684241.036214:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684241.036227:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684241.036234:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684241.036240:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684241.036245:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684241.036252:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684241.036269:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8d6647575900) 00010000:00010000:0.0:1788684241.036272:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684241.036277:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684241.036283:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acc75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684241.046011:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788684241.046026:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1788684241.533598:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684242.558334:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684242.618061:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684242.618124:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684242.618157:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684242.618180:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684242.618200:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684242.618223:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684242.618248:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684242.618284:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073159680 00000100:00100000:1.0:1788684242.618303:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073159680 00000100:00100000:1.0:1788684242.618394:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073160192 00000100:00100000:1.0:1788684242.618398:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073160192 00000100:00100000:1.0:1788684242.618421:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073159552 00000100:00100000:1.0:1788684242.618428:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073159552 00000100:00100000:1.0:1788684242.618444:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073160064 00000100:00100000:1.0:1788684242.618447:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073160064 00000100:00100000:1.0:1788684242.618463:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 281 00000100:00100000:1.0:1788684242.618473:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073159680:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684242.618568:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073159680:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 95us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684242.618581:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 281 00000100:00100000:1.0:1788684242.618614:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 282 00000100:00100000:1.0:1788684242.618621:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073160192:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684242.618644:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073160192:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684242.618650:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 282 00000100:00100000:1.0:1788684242.618660:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 283 00000100:00100000:1.0:1788684242.618665:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:2391:x1875571073159552:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684242.618688:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:2391:x1875571073159552:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684242.618694:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 283 00000100:00100000:1.0:1788684242.618705:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 284 00000100:00100000:1.0:1788684242.618711:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073160064:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684242.618735:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073160064:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684242.618830:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 284 00000100:00100000:1.0:1788684242.618924:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073159936 00000100:00100000:1.0:1788684242.618928:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073159936 00000100:00100000:1.0:1788684242.618956:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073159808 00000100:00100000:1.0:1788684242.618958:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073159808 00000100:00100000:1.0:1788684242.618974:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00100000:1.0:1788684242.618979:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677e51d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2391:x1875571073159936:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684242.619004:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677e51d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2391:x1875571073159936:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684242.619010:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00100000:0.0:1788684242.619107:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073159424 00000100:00100000:0.0:1788684242.619112:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073159424 00000100:00100000:0.0:1788684242.619153:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 381 00000100:00100000:0.0:1788684242.619160:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073159424:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684242.619187:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073159424:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 29us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684242.619193:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 381 00000100:00080000:0.0:1788684242.619435:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684242.619441:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684242.619444:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684242.619446:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684242.619465:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 107 00000100:00100000:0.0:1788684242.619474:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073159808:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684242.619510:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073159808:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684242.619517:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 107 00000100:00100000:1.0:1788684243.241824:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684243.241938:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073160320 00000100:00100000:3.0:1788684243.241949:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073160320 00000100:00100000:3.0:1788684243.242007:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 147 00000100:00100000:3.0:1788684243.242017:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:11069:x1875571073160320:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788684243.242153:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:11069:x1875571073160320:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 136us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684243.242161:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 147 00000100:00100000:0.0:1788684243.252456:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684243.252802:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073160448 00000100:00100000:3.0:1788684243.252812:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073160448 00000100:00100000:3.0:1788684243.252872:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 148 00000100:00100000:3.0:1788684243.252882:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:11069:x1875571073160448:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788684243.252984:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:11069:x1875571073160448:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 103us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684243.252992:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 148 00000100:00100000:1.0:1788684243.284344:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684243.284452:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073160704 00000100:00100000:3.0:1788684243.284489:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073160704 00000100:00100000:3.0:1788684243.284554:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:3.0:1788684243.284564:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:11069:x1875571073160704:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788684243.285159:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:11069:x1875571073160704:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 592us (822us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788684243.285169:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:1.0:1788684243.478429:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684243.478581:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073160832 00000100:00100000:0.0:1788684243.478591:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073160832 00000100:00100000:0.0:1788684243.478664:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 149 00000100:00100000:0.0:1788684243.478674:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:11882:x1875571073160832:12345-192.168.206.44@tcp:101:lsof.0 00010000:00010000:0.0:1788684243.478693:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684243.478715:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c36 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684243.478776:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684243.478790:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684243.478819:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684243.478863:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788684243.478867:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684243.478904:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684243.478938:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c36 expref: 7 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684243.478955:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c36 expref: 6 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684243.478963:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:0.0:1788684243.478966:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684243.478970:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891c00, rc 0) 00000100:00100000:0.0:1788684243.479038:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:11882:x1875571073160832:12345-192.168.206.44@tcp:101:lsof.0 Request processed in 365us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684243.479045:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 149 00010000:00010000:3.0:1788684243.581506:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684244.094030:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085805568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684244.094099:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684244.094173:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684244.094180:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085805696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684244.094205:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684244.094277:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085805568 00000100:00100000:3.0:1788684244.094286:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085805568 00000100:00100000:3.0:1788684244.094356:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085805696 00000100:00100000:3.0:1788684244.094359:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085805696 00000100:00100000:3.0:1788684244.094398:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788684244.094406:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085805568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684244.094434:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684244.094479:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085805568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684244.094486:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788684244.094501:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788684244.094508:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085805696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684244.094517:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788684244.094542:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085805696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684244.094548:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788684244.094902:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684244.094943:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788684244.094949:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1788684244.094967:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d664842a680, transno 4294967305 00000100:00100000:1.0:1788684244.094990:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085805696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684244.095006:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085805568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684244.095539:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085805952:0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.095586:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684244.095634:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085806464:0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.095656:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684244.095674:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085806976:0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.095693:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684244.095725:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788684244.095732:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085805824:0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.095759:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684244.095777:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085806336:0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.095797:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684244.095814:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085806848:0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.095830:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684244.095854:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085806976 00000100:00100000:0.0:1788684244.095859:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085806976 00000100:00100000:0.0:1788684244.095896:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788684244.095903:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085806976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.095957:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085806976:12345-0@lo:400:kworker.0 Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684244.095964:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788684244.095984:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085806336 00000100:00100000:0.0:1788684244.095987:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085806336 00000100:00100000:0.0:1788684244.096010:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788684244.096015:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085806336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.096046:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085806336:12345-0@lo:400:kworker.0 Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684244.096052:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788684244.096071:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085805952 00000100:00100000:0.0:1788684244.096074:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085805952 00000100:00100000:0.0:1788684244.096096:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085806464 00000100:00100000:0.0:1788684244.096099:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085806464 00000100:00100000:0.0:1788684244.096115:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085806848 00000100:00100000:0.0:1788684244.096117:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085806848 00000100:00100000:0.0:1788684244.096133:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788684244.096146:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085805952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.096174:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085805952:12345-0@lo:400:kworker.0 Request processed in 29us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684244.096181:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788684244.096191:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788684244.096197:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085806464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.096219:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085806464:12345-0@lo:400:kworker.0 Request processed in 22us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684244.096224:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788684244.096233:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788684244.096238:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085806848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.096260:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085806848:12345-0@lo:400:kworker.0 Request processed in 22us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684244.096265:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788684244.096293:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085806336:0@lo:400:kworker.0 00010000:00080000:0.0:1788684244.096304:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777063b80 x1875571085806848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684244.096314:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085806848:0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.096323:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085805952:0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.096330:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085806464:0@lo:400:kworker.0 00000100:00100000:0.0:1788684244.096338:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085806976:0@lo:400:kworker.0 00000100:00080000:1.0:1788684244.096738:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684244.096750:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684244.096753:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684244.096767:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085806080:0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.096801:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684244.096831:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085806592:0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.096856:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684244.096875:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085807104:0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.096896:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684244.096929:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788684244.096936:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085806208:0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.096959:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684244.096977:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085806720:0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.097008:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684244.097036:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085807104 00000100:00100000:1.0:1788684244.097041:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085807104 00000100:00100000:1.0:1788684244.097076:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788684244.097083:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085807104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.097117:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085807104:12345-0@lo:400:kworker.0 Request processed in 34us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684244.097123:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788684244.097144:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085806592 00000100:00100000:1.0:1788684244.097147:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085806592 00000100:00100000:1.0:1788684244.097163:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085806208 00000100:00100000:1.0:1788684244.097165:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085806208 00000100:00100000:1.0:1788684244.097176:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085806720 00000100:00100000:1.0:1788684244.097178:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085806720 00000100:00100000:1.0:1788684244.097191:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788684244.097196:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085806592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.097235:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085806592:12345-0@lo:400:kworker.0 Request processed in 38us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684244.097242:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788684244.097255:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788684244.097261:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085806208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.097287:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085806208:12345-0@lo:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684244.097293:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788684244.097304:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788684244.097310:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085806720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.097336:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085806720:12345-0@lo:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684244.097341:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:1.0:1788684244.097616:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684244.097620:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684244.097621:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684244.097654:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085806208:0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.097665:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085806720:0@lo:400:kworker.0 00010000:00080000:1.0:1788684244.097677:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6777061f80 x1875571085806592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684244.097686:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085806592:0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.097693:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788684244.097698:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d664799ce00, transno 4294967311 00000004:00080000:1.0:1788684244.097708:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788684244.097732:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085807104:0@lo:400:kworker.0 00000100:00100000:3.0:1788684244.098549:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085805824 00000100:00100000:3.0:1788684244.098558:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085805824 00000100:00100000:3.0:1788684244.098617:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788684244.098626:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085805824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684244.098706:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085805824:12345-0@lo:400:kworker.0 Request processed in 81us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684244.098713:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788684244.098749:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085806080 00000100:00100000:3.0:1788684244.098753:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085806080 00000100:00100000:3.0:1788684244.098775:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788684244.098781:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085806080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684244.098818:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085806080:12345-0@lo:400:kworker.0 Request processed in 37us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684244.098824:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788684244.099033:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085805824:0@lo:400:kworker.0 00000100:00100000:1.0:1788684244.101106:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085806080:0@lo:400:kworker.0 00000100:00100000:3.0:1788684244.606554:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085807232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684244.606640:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684244.606742:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684244.606861:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085807232 00000100:00100000:3.0:1788684244.606868:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085807232 00000100:00100000:3.0:1788684244.606910:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788684244.606918:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085807232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788684244.606950:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788684244.607195:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085807360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684244.607229:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684244.607267:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684244.607272:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085807488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684244.607294:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684244.607321:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085807488 00000100:00100000:2.0:1788684244.607326:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085807488 00000100:00100000:2.0:1788684244.607349:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788684244.607387:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085807488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684244.607399:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788684244.607448:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085807488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684244.607455:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788684244.607500:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085807488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684244.607655:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085807360 00000100:00100000:0.0:1788684244.607659:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085807360 00000100:00100000:0.0:1788684244.607699:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788684244.607705:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085807360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788684244.607726:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788684244.607759:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085807360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684244.607765:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788684244.608172:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085807232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1253us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684244.608180:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788684244.608215:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085807232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684244.610582:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085807360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684245.117667:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085807616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684245.117736:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684245.118439:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085807616 00000100:00100000:0.0:1788684245.118448:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085807616 00000100:00100000:0.0:1788684245.118496:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788684245.118506:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085807616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684245.118536:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788684245.118613:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085807616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684245.118619:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788684245.118705:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085807616:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788684245.635213:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684246.655118:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788684247.171782:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1788684247.171795:0:6476:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788684247.171843:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788684247.171854:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:0.0:1788684247.554634:0:14536:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:44:06 (1788684246) 00010000:00010000:0.0:1788684247.681512:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684247.749436:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684247.749474:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684247.749505:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684247.749532:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073161472 00000100:00100000:0.0:1788684247.749540:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073161472 00000100:00100000:0.0:1788684247.749606:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 110 00000100:00100000:0.0:1788684247.749616:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073161472:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684247.749684:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073161472:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684247.749702:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 110 00000100:00080000:0.0:1788684247.749725:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684247.749754:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684247.749862:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684247.749883:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684247.749907:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684247.749925:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073161216 00000100:00100000:0.0:1788684247.749929:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073161216 00000100:00100000:0.0:1788684247.749957:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073161728 00000100:00100000:0.0:1788684247.749960:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073161728 00000100:00100000:0.0:1788684247.749976:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073161088 00000100:00100000:0.0:1788684247.749979:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073161088 00000100:00100000:0.0:1788684247.749990:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073161600 00000100:00100000:0.0:1788684247.749992:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073161600 00000100:00100000:0.0:1788684247.750013:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 291 00000100:00100000:0.0:1788684247.750021:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073161216:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684247.750058:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073161216:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 38us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684247.750064:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 291 00000100:00100000:0.0:1788684247.750077:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 292 00000100:00100000:0.0:1788684247.750084:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073161728:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684247.750307:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073160960 00000100:00100000:3.0:1788684247.750312:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073160960 00000100:00100000:3.0:1788684247.750350:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 383 00000100:00100000:3.0:1788684247.750384:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073160960:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684247.750415:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677480f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073160960:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 50us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684247.750422:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 383 00000100:00100000:3.0:1788684247.750454:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 293 00000100:00100000:3.0:1788684247.750461:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:2390:x1875571073161088:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684247.750492:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:2390:x1875571073161088:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 32us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684247.750498:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 293 00000100:00100000:3.0:1788684247.750510:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 294 00000100:00100000:3.0:1788684247.750515:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2390:x1875571073161600:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684247.750549:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2390:x1875571073161600:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 32us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684247.750555:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 294 00000100:00100000:0.0:1788684247.753337:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073161728:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 3248us (3577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684247.755231:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 292 00000100:00100000:0.0:1788684247.755295:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073161344 00000100:00100000:0.0:1788684247.755304:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073161344 00000100:00100000:0.0:1788684247.755388:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 111 00000100:00100000:0.0:1788684247.755414:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073161344:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684247.755475:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073161344:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 64us (5591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684247.755483:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 111 00000100:00080000:0.0:1788684247.755645:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684247.755650:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684247.755652:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788684248.701758:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684248.858646:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684248.858730:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073161984 00000100:00100000:0.0:1788684248.858746:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073161984 00000100:00100000:0.0:1788684248.858822:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 150 00000100:00100000:0.0:1788684248.858832:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:12149:x1875571073161984:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684248.858854:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684248.858877:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acd0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c3d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.858954:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.858969:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.858980:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859022:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859030:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859057:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859148:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acd24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859157:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acd24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859164:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acd24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684248.859173:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788684248.859257:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859265:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859272:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859278:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684248.859282:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859290:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859302:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d677cc3c700) 00010000:00010000:0.0:1788684248.859305:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684248.859317:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859324:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54acd16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859338:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859343:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859349:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859354:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684248.859357:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859362:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859427:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d6750bd9500) 00010000:00010000:0.0:1788684248.859429:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684248.859432:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859438:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acd1d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859708:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acd0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c3d expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859733:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acd24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c3d expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684248.859739:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:0.0:1788684248.859742:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684248.859743:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891800, rc 0) 00000100:00100000:0.0:1788684248.859820:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:12149:x1875571073161984:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 989us (1188us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788684248.859828:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 150 00000100:00100000:0.0:1788684248.866781:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684248.866897:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684248.867020:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073162112 00000100:00100000:3.0:1788684248.867029:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073162112 00000100:00100000:3.0:1788684248.867162:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:3.0:1788684248.867173:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:2391:x1875571073162112:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684248.867188:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684248.867213:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acd24 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c3d expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684248.867231:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:3.0:1788684248.867246:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684248.867297:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:2391:x1875571073162112:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 125us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684248.867305:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:1.0:1788684248.870999:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073162240 00000100:00100000:1.0:1788684248.871015:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073162240 00000100:00100000:1.0:1788684248.871070:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 151 00000100:00100000:1.0:1788684248.871080:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:12149:x1875571073162240:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788684248.871199:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:12149:x1875571073162240:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 120us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684248.871207:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 151 00000100:00100000:3.0:1788684248.874650:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684248.874776:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073162368 00000100:00100000:0.0:1788684248.874785:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073162368 00000100:00100000:0.0:1788684248.874850:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:0.0:1788684248.874861:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6775ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:12149:x1875571073162368:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788684248.874967:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6775ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:12149:x1875571073162368:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 107us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684248.874975:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 152 00000040:00080000:0.0:1788684249.023298:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788684249.213842:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66478a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085807744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684249.213910:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684249.214135:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085807744 00000100:00100000:0.0:1788684249.214144:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085807744 00000100:00100000:0.0:1788684249.214236:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788684249.214244:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085807744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684249.214271:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684249.214318:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085807744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684249.214339:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788684249.214423:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66478a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085807744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684249.214456:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085807872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684249.214484:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684249.214513:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085807872 00000100:00100000:0.0:1788684249.214517:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085807872 00000100:00100000:3.0:1788684249.215535:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085808000:0@lo:400:kworker.0 00000100:00100000:2.0:1788684249.215564:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085808128:0@lo:400:kworker.0 00000100:00100000:3.0:1788684249.215592:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684249.215610:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684249.215621:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085808512:0@lo:400:kworker.0 00000100:00100000:2.0:1788684249.215626:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085808640:0@lo:400:kworker.0 00000100:00100000:2.0:1788684249.215642:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684249.215643:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684249.215657:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085809152:0@lo:400:kworker.0 00000100:00100000:3.0:1788684249.215661:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085809024:0@lo:400:kworker.0 00000100:00100000:3.0:1788684249.215677:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684249.215677:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684249.215694:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788684249.215694:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788684249.215700:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085808384:0@lo:400:kworker.0 00000100:00100000:2.0:1788684249.215700:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085808256:0@lo:400:kworker.0 00000100:00100000:3.0:1788684249.215720:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684249.215720:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684249.215735:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085808896:0@lo:400:kworker.0 00000100:00100000:2.0:1788684249.215735:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085808768:0@lo:400:kworker.0 00000100:00100000:3.0:1788684249.215753:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684249.215782:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085808128 00000100:00100000:3.0:1788684249.215799:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085808128 00000100:00100000:3.0:1788684249.215832:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085808640 00000100:00100000:3.0:1788684249.215835:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085808640 00000100:00100000:2.0:1788684249.215922:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085809024 00000100:00100000:2.0:1788684249.215936:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085809024 00000100:00080000:1.0:1788684249.221950:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684249.221960:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684249.221964:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684249.221990:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085808000 00000100:00100000:1.0:1788684249.221999:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085808000 00000100:00100000:1.0:1788684249.222067:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788684249.222078:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085808000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.222171:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085808000:12345-0@lo:400:kworker.0 Request processed in 95us (6578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.222178:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788684249.222218:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085808384 00000100:00100000:1.0:1788684249.222222:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085808384 00000100:00100000:1.0:1788684249.222240:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085808896 00000100:00100000:1.0:1788684249.222243:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085808896 00000100:00100000:1.0:1788684249.222284:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788684249.222290:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085808128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.222327:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085808128:12345-0@lo:400:kworker.0 Request processed in 37us (6716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.222333:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788684249.222347:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788684249.222353:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085808384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.222403:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085808384:12345-0@lo:400:kworker.0 Request processed in 51us (6682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.222409:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788684249.222421:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788684249.222427:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085808896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.222456:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085808896:12345-0@lo:400:kworker.0 Request processed in 29us (6701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.222462:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788684249.222507:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085808384:0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.222519:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085808896:0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.222529:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085808000:0@lo:400:kworker.0 00000100:00080000:1.0:1788684249.222557:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684249.223608:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085809152 00000100:00100000:1.0:1788684249.223618:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085809152 00000100:00100000:1.0:1788684249.223671:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788684249.223680:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085809152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.223746:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085809152:12345-0@lo:400:kworker.0 Request processed in 68us (8067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.223764:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1788684249.223783:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684249.223800:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085808512 00000100:00100000:1.0:1788684249.223805:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085808512 00000100:00100000:1.0:1788684249.223834:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085808256 00000100:00100000:1.0:1788684249.223838:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085808256 00000100:00100000:1.0:1788684249.223852:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788684249.223858:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085808512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.223899:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085808512:12345-0@lo:400:kworker.0 Request processed in 41us (8254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.223905:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788684249.223918:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788684249.223925:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085808256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.223957:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085808256:12345-0@lo:400:kworker.0 Request processed in 32us (8236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.223963:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788684249.223998:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085808512:0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.224057:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684249.224093:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085809280:0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.224126:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684249.224155:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085808128:0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.224167:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085809152:0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.224186:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085808256:0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.224204:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085808768 00000100:00100000:1.0:1788684249.224214:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085808768 00000100:00100000:1.0:1788684249.224247:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788684249.224254:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085808768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684249.224291:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085808768:12345-0@lo:400:kworker.0 Request processed in 38us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.224298:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00010000:00080000:1.0:1788684249.224327:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648602300 x1875571085808768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684249.224338:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085808768:0@lo:400:kworker.0 00000100:00080000:1.0:1788684249.224356:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684249.225298:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085809280 00000100:00100000:0.0:1788684249.225306:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085809280 00000100:00100000:0.0:1788684249.225341:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788684249.225348:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085809280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684249.225438:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085809280:12345-0@lo:400:kworker.0 Request processed in 90us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684249.225445:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788684249.225483:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085809280:0@lo:400:kworker.0 00000100:00100000:0.0:1788684249.225524:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788684249.225531:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085807872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788684249.225547:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684249.225596:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085807872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (11111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684249.225604:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788684249.225637:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085807872:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788684249.228190:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684249.228872:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788684249.228885:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085808640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684249.228970:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085808640:12345-0@lo:400:kworker.0 Request processed in 89us (13326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684249.228977:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788684249.229020:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085808640:0@lo:400:kworker.0 00000100:00100000:2.0:1788684249.235210:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788684249.235225:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085809024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684249.235316:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085809024:12345-0@lo:400:kworker.0 Request processed in 95us (19636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684249.235324:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00080000:2.0:1788684249.235381:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648602a00 x1875571085809024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684249.235396:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085809024:0@lo:400:kworker.0 00000100:00100000:3.0:1788684249.728562:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085809408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684249.728562:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085809664:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788684249.728815:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684249.728821:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684249.729312:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788684249.729334:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788684249.730536:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684249.733648:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684249.733724:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085809536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684249.733775:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684249.733885:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085809408 00000100:00100000:1.0:1788684249.733896:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085809408 00000100:00100000:1.0:1788684249.733956:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788684249.733966:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085809408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684249.733998:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788684249.734047:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085809408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.734055:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788684249.734080:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085809536 00000100:00100000:1.0:1788684249.734084:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085809536 00000100:00100000:1.0:1788684249.734112:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788684249.734119:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085809536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684249.734142:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684249.734175:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085809536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684249.734181:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788684249.734599:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085809408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684249.734617:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085809536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684249.735849:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684249.735926:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085809664 00000100:00100000:0.0:1788684249.735934:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085809664 00000100:00100000:0.0:1788684249.735980:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788684249.735989:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085809664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684249.736009:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788684249.736054:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085809664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684249.736061:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788684249.736113:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085809664:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788684250.046654:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788684250.237691:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684250.237718:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085809792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684250.237787:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684250.237948:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085809792 00000100:00100000:2.0:1788684250.237956:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085809792 00000100:00100000:2.0:1788684250.238010:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788684250.238019:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085809792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684250.238052:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788684250.239226:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085809792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1205us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684250.239235:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788684250.245660:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085809792:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788684250.754066:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788684250.754077:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788684250.754195:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788684250.754203:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788684250.756465:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684251.198661:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.198748:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073162496 00000100:00100000:1.0:1788684251.198760:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073162496 00000100:00100000:1.0:1788684251.198852:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00100000:1.0:1788684251.198863:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66478a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:12191:x1875571073162496:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684251.198887:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684251.198912:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c44 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.198989:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.199006:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.199021:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.199037:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.199044:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.199050:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.199111:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788684251.199343:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788684251.200215:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200224:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200231:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684251.200236:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200246:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200264:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:1.0:1788684251.200267:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684251.200272:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200278:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200295:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200301:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200308:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200314:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684251.200329:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200337:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200346:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d6641867e00) 00010000:00010000:1.0:1788684251.200348:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684251.200352:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.200358:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.201309:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c44 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.201329:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:1.0:1788684251.201331:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684251.201654:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c44 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.201669:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0000, rc 0) 00000100:00100000:1.0:1788684251.201918:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66478a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:12191:x1875571073162496:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 3054us (3264us total) trans 0 rc 301/301 00000100:00100000:1.0:1788684251.201929:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00100000:0.0:1788684251.214218:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.214420:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073162752 00000100:00100000:1.0:1788684251.214431:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073162752 00000100:00100000:1.0:1788684251.214504:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 154 00000100:00100000:1.0:1788684251.214515:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+14:12191:x1875571073162752:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:1.0:1788684251.214608:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684251.214643:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ac686 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a68 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.214663:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:1.0:1788684251.214669:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684251.214745:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.214761:0:13784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c36 expref: 5 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.214770:0:13784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.214813:0:13784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c36 expref: 5 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.214828:0:13784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c36 expref: 5 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684251.214846:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13784:1875571085809920:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684251.214962:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684251.222236:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13784:1875571085809920:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684251.222274:0:13784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684251.223973:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684251.224090:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073162880 00000100:00100000:2.0:1788684251.224100:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073162880 00000100:00080000:1.0:1788684251.224306:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788684251.224327:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c36 expref: 6 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684251.224592:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:2.0:1788684251.224602:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2392:x1875571073162880:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684251.224631:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684251.224639:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c36 expref: 6 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.224651:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c36 expref: 6 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.224676:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54acd08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c36 expref: 6 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.224689:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:2.0:1788684251.224694:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.224704:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.224712:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.224880:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684251.224944:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2392:x1875571073162880:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 342us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684251.224953:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 79 00010000:00010000:1.0:1788684251.225580:0:13784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.225593:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.225622:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.225634:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.225644:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228341:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228387:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228400:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684251.228619:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026f28b27 reply state 00000000637483fb transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228632:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228639:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:1.0:1788684251.228642:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684251.228646:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788684251.228660:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788684251.228670:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228677:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228684:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228690:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684251.228696:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228705:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228718:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3c300) 00010000:00010000:1.0:1788684251.228720:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684251.228725:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228793:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54acd47 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684251.228818:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026f28b27 reply state 00000000637483fb transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228826:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.228833:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d6641867e00) 00010000:00010000:1.0:1788684251.228836:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684251.228845:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788684251.228954:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:12191:x1875571073162752:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 14434us (14742us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788684251.228963:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 154 00000100:00100000:0.0:1788684251.335847:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684251.335930:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073163008 00000100:00100000:2.0:1788684251.335944:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073163008 00000100:00100000:2.0:1788684251.336013:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 155 00000100:00100000:2.0:1788684251.336026:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+15:12199:x1875571073163008:12345-192.168.206.44@tcp:101:lctl.0 00010000:00010000:2.0:1788684251.336078:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684251.336107:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acd5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c4b expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.336298:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acd63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.336316:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acd63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.336330:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acd63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684251.336570:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788684251.336574:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684251.336605:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acd63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.336635:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acd5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c4b expref: 17 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.336654:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acd63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c4b expref: 16 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.336665:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647580f00) 00010000:00010000:2.0:1788684251.336668:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684251.336671:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5800, rc 0) 00000100:00100000:2.0:1788684251.336795:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:12199:x1875571073163008:12345-192.168.206.44@tcp:101:lctl.0 Request processed in 770us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684251.336804:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 155 00000100:00100000:3.0:1788684251.388531:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684251.388678:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073163136 00000100:00100000:2.0:1788684251.388690:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073163136 00000100:00100000:2.0:1788684251.388771:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 156 00000100:00100000:2.0:1788684251.388783:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+16:12205:x1875571073163136:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684251.388812:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684251.388839:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acd6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c52 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.388920:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.388937:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.388949:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.388961:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.388968:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.388974:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389074:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54acd7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389083:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54acd7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389112:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54acd7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684251.389158:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788684251.389161:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684251.389186:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54acd7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389199:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389207:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389213:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389219:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684251.389224:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389233:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389246:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647580f00) 00010000:00010000:2.0:1788684251.389249:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684251.389254:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389260:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389287:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389294:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389299:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389304:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684251.389307:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389312:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389321:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d6641867e00) 00010000:00010000:2.0:1788684251.389323:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684251.389325:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389330:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389357:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acd6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c52 expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389425:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54acd7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c52 expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.389446:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684251.389449:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788684251.389451:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4800, rc 0) 00000100:00100000:2.0:1788684251.389530:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:12205:x1875571073163136:12345-192.168.206.44@tcp:101:bash.0 Request processed in 749us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684251.389539:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 156 00000100:00100000:0.0:1788684251.393185:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684251.393485:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073163392 00000100:00100000:2.0:1788684251.393498:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073163392 00000100:00100000:2.0:1788684251.393845:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 157 00000100:00100000:2.0:1788684251.393858:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:12205:x1875571073163392:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684251.393884:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684251.393909:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acd86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c59 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.394041:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.394057:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.394069:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.397273:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.397296:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.397532:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788684251.397938:0:12443:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788684251.398073:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398084:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398092:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398128:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398135:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398141:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398147:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684251.398151:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398158:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398170:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684251.398173:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684251.398185:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398191:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acd8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684251.398203:0:12443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bb4b627 reply state 00000000226724dd transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398213:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398219:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580200) 00010000:00010000:2.0:1788684251.398221:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684251.398223:0:12443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788684251.398257:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acd86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c59 expref: 20 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398272:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c59 expref: 19 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.398278:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6647580900) 00010000:00010000:2.0:1788684251.398281:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684251.398283:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5a00, rc 0) 00000100:00100000:2.0:1788684251.399062:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:12205:x1875571073163392:12345-192.168.206.44@tcp:101:bash.0 Request processed in 5204us (5889us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788684251.399071:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 157 00000100:00100000:3.0:1788684251.407092:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.407204:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073163520 00000100:00100000:1.0:1788684251.407222:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073163520 00000100:00100000:1.0:1788684251.407328:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00080000:0.0:1788684251.407332:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684251.407346:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073163520:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1788684251.407415:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684251.407443:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c60 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788684251.407475:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684251.407502:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1788684251.407508:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684251.407520:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c60 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.407542:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c60 expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.407572:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0000, rc 0) 00000100:00100000:1.0:1788684251.407653:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073163520:12345-192.168.206.44@tcp:101:bash.0 Request processed in 313us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684251.407661:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:3.0:1788684251.409759:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684251.409942:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073163648 00000100:00100000:0.0:1788684251.409952:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073163648 00000100:00100000:0.0:1788684251.410009:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:0.0:1788684251.410020:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:12205:x1875571073163648:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1788684251.410052:0:9991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684251.410070:0:9991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c67 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.410100:0:9991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c60 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.410109:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684251.410113:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684251.410118:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 7 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.410150:0:9991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c60 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.410164:0:9991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c60 expref: 7 pid: 8412 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684251.410178:0:9991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9991:1875571085810048:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684251.410274:0:9991:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777249d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684251.412619:0:9991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9991:1875571085810048:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684251.412652:0:9991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 7 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684251.412674:0:9991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890e00, rc 0) 00000100:00100000:3.0:1788684251.412732:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:12205:x1875571073163648:12345-192.168.206.44@tcp:101:bash.0 Request processed in 2713us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684251.412740:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:3.0:1788684251.413226:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684251.413299:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073163776 00000100:00100000:2.0:1788684251.413305:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073163776 00010000:00010000:2.0:1788684251.413336:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c60 expref: 7 pid: 8412 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684251.413429:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:2.0:1788684251.413439:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073163776:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684251.413452:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684251.413471:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c60 expref: 7 pid: 8412 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.413483:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c60 expref: 7 pid: 8412 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.413507:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54acda9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c60 expref: 7 pid: 8412 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.413522:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684251.413526:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684251.413534:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 6 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.413568:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 6 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.413600:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 6 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684251.413614:0:6483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6483:1875571085810176:192.168.206.44@tcp:105: 00000100:00100000:2.0:1788684251.413673:0:6483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684251.415273:0:6483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6483:1875571085810176:192.168.206.44@tcp:105: 00010000:00010000:3.0:1788684251.415295:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684251.415345:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073163776:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 1907us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684251.415355:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:0.0:1788684251.420525:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684251.420726:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073164032 00000100:00100000:3.0:1788684251.420735:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073164032 00000100:00100000:3.0:1788684251.420790:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:3.0:1788684251.420801:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:12205:x1875571073164032:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:3.0:1788684251.421078:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12205:x1875571073164032:12345-192.168.206.44@tcp:35:bash.0 Request processed in 277us (560us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788684251.421086:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:0.0:1788684251.488424:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.488508:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073164288 00000100:00100000:1.0:1788684251.488522:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073164288 00000100:00100000:1.0:1788684251.488620:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 158 00000100:00100000:1.0:1788684251.488631:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12215:x1875571073164288:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684251.488652:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684251.488672:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54acdb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684251.488761:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788684251.488854:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54acdb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c6e expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.488868:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647580f00) 00010000:00010000:1.0:1788684251.488871:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684251.488876:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54acdb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c6e expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.488889:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1a00, rc 0) 00000100:00100000:1.0:1788684251.488952:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:12215:x1875571073164288:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 323us (541us total) trans 4294967422 rc 301/301 00000100:00100000:1.0:1788684251.488959:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 158 00000100:00100000:0.0:1788684251.491239:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684251.491334:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073164544 00000100:00100000:3.0:1788684251.491345:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073164544 00000100:00100000:3.0:1788684251.491455:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:3.0:1788684251.491468:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:12215:x1875571073164544:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1788684251.491741:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:12215:x1875571073164544:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 275us (514us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788684251.491750:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:0.0:1788684251.558716:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.558828:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073164672 00000100:00100000:1.0:1788684251.558842:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073164672 00000100:00100000:1.0:1788684251.558920:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 159 00000100:00100000:1.0:1788684251.558933:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:12221:x1875571073164672:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684251.558963:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684251.558992:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54acdc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c75 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.559106:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54acdcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.559136:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54acdcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.559148:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54acdcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684251.559200:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788684251.559205:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684251.559226:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54acdcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.559257:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54acdc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c75 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.559279:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54acdcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c75 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.559289:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:1.0:1788684251.559293:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788684251.559297:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0400, rc 0) 00000100:00100000:1.0:1788684251.559673:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:12221:x1875571073164672:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 741us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684251.559683:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 159 00000100:00100000:0.0:1788684251.563856:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.563960:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073164928 00000100:00100000:1.0:1788684251.563974:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073164928 00000100:00100000:1.0:1788684251.564061:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 160 00000100:00100000:1.0:1788684251.564072:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:12221:x1875571073164928:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684251.564096:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684251.564132:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54acdd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c7c expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.564267:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54acdda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.564283:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54acdda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.564295:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54acdda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684251.564307:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788684251.564774:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54acdd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c7c expref: 27 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.564810:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54acdda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c7c expref: 26 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.564822:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6647580900) 00010000:00010000:1.0:1788684251.564825:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788684251.564829:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1c00, rc 0) 00000100:00100000:1.0:1788684251.564911:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+26:12221:x1875571073164928:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 840us (1069us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788684251.564919:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 160 00000100:00100000:0.0:1788684251.569305:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.569617:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073165184 00000100:00100000:1.0:1788684251.569635:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073165184 00000100:00100000:1.0:1788684251.569706:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 161 00000100:00100000:1.0:1788684251.569717:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+26:12221:x1875571073165184:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684251.569748:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684251.569785:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54acde8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c83 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.569914:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54acdef lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.569931:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54acdef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.569944:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54acdef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684251.569958:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788684251.570089:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54acde8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c83 expref: 29 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.570309:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54acdef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c83 expref: 28 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.570330:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6647580900) 00010000:00010000:1.0:1788684251.570333:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788684251.570337:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1e00, rc 0) 00000100:00100000:1.0:1788684251.570711:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+28:12221:x1875571073165184:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 994us (1417us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1788684251.570720:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 161 00000100:00100000:0.0:1788684251.575732:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684251.580818:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073165312 00000100:00100000:3.0:1788684251.580839:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073165312 00000100:00100000:3.0:1788684251.580962:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:3.0:1788684251.580973:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+28:2390:x1875571073165312:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684251.580992:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684251.581024:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54acdda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c7c expref: 28 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684251.581047:0:9510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6647580900) 00010000:00010000:3.0:1788684251.581054:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684251.581129:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:2390:x1875571073165312:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 158us (5413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684251.581157:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:0.0:1788684251.584142:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684251.584275:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073165440 00000100:00100000:2.0:1788684251.584288:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073165440 00000100:00100000:2.0:1788684251.584565:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:2.0:1788684251.584579:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073165440:12345-192.168.206.44@tcp:1:lfs.0 00010000:00010000:2.0:1788684251.584638:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.584664:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 6 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.584674:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684251.584679:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684251.584684:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.584728:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 6 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.584745:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 6 pid: 9991 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684251.584762:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875571085810304:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684251.584937:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:3.0:1788684251.589228:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.589310:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073165568 00000100:00100000:1.0:1788684251.589330:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073165568 00002000:00100000:1.0:1788684251.589408:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d677fbf6d80 x1875571073165568/t0(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:172/0 lens 504/0 e 0 to 0 dl 1788684262 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788684251.589428:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d677fbf6d80 with x1875571073165568 ext(0->12) 00010000:00010000:1.0:1788684251.589449:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 7 pid: 9991 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.589470:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 7 pid: 9991 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788684251.589479:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d677fbf6d80 00000100:00100000:1.0:1788684251.589513:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:1.0:1788684251.589524:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073165568:12345-192.168.206.44@tcp:4:lfs.0 00000100:00100000:2.0:1788684251.591401:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875571085810304:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684251.591450:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684251.592323:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2392:x1875571073165568:12345-192.168.206.44@tcp:4:lfs.0 Request processed in 2786us (3095us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788684251.592337:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00002000:00100000:1.0:1788684251.592351:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8d677fbf6d80 x1875571073165568/t4294967306(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:172/0 lens 504/448 e 0 to 0 dl 1788684262 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788684251.592361:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d677fbf6d80 with x1875571073165568 ext(0->12) 00010000:00010000:1.0:1788684251.592388:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 9 pid: 9991 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.592407:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 9 pid: 9991 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788684251.592430:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d677fbf6d80 00000100:00100000:3.0:1788684251.595962:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684251.596062:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073165696 00000100:00100000:2.0:1788684251.596075:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073165696 00010000:00010000:2.0:1788684251.596122:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 9 pid: 9991 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684251.596172:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:2.0:1788684251.596183:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2392:x1875571073165696:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684251.596200:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788684251.596227:0:6484:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788684251.596231:0:6484:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788684251 00002000:00010000:2.0:1788684251.596233:0:6484:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788684251 00002000:00010000:2.0:1788684251.596236:0:6484:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788684251 00002000:00010000:2.0:1788684251.596238:0:6484:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788684251.596246:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 9 pid: 9991 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.596261:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 9 pid: 9991 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.596288:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54acdb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c67 expref: 9 pid: 9991 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.596308:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684251.596327:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684251.596334:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.596362:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.596577:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684251.596642:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073165696:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 459us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684251.596651:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 81 00010000:00010000:0.0:1788684251.597581:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.597598:0:8413:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.597628:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.597637:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.597646:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.597655:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684251.597660:0:8413:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.597670:0:8413:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.597688:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.597716:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065172ece/0x44bac02bd54acdfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684251.597810:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073165440:12345-192.168.206.44@tcp:1:lfs.0 Request processed in 13233us (13679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684251.597820:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:0.0:1788684251.605041:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684251.605282:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073165952 00000100:00100000:2.0:1788684251.605294:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073165952 00000100:00100000:2.0:1788684251.605711:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:2.0:1788684251.605725:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749555850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:12221:x1875571073165952:12345-192.168.206.44@tcp:35:lfs.0 00000004:00010000:2.0:1788684251.605808:0:6501:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54acdef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c83 expref: 27 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684251.606200:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788684251.606237:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1788684251.607399:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1788684251.607529:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.607551:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c59 expref: 31 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.607572:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.607618:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c59 expref: 31 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.607654:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c59 expref: 31 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684251.607673:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1875571085810432:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684251.607850:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684251.612353:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684251.612669:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073166080 00000100:00100000:3.0:1788684251.612682:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073166080 00010000:00010000:3.0:1788684251.612733:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c59 expref: 32 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684251.612790:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:3.0:1788684251.612801:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:2392:x1875571073166080:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684251.612820:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684251.612828:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c59 expref: 32 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684251.612844:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c59 expref: 32 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684251.612872:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6647580900) 00010000:00010000:3.0:1788684251.612878:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684251.612898:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684251.612908:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684251.612932:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684251.613012:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:2392:x1875571073166080:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 212us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684251.613021:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 82 00010000:00010000:1.0:1788684251.613201:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54acd9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c59 expref: 31 pid: 12443 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684251.613223:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6501:1875571085810432:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684251.613253:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.613264:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.613272:0:6501:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788684251.613454:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:1.0:1788684251.613595:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788684251.613711:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085810560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788684251.613770:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684251.613849:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085810560 00000100:00100000:0.0:1788684251.613855:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085810560 00000100:00100000:0.0:1788684251.613917:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788684251.613924:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6501:x1875571085810560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788684251.614007:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6501:x1875571085810560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684251.614015:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1788684251.614040:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684251.614052:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684251.614074:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085810560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788684251.614259:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:1.0:1788684251.614300:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085810688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788684251.614327:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684251.614352:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684251.614441:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085810688 00000100:00100000:3.0:1788684251.614447:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085810688 00000100:00100000:3.0:1788684251.614483:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788684251.614490:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6501:x1875571085810688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788684251.614611:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6501:x1875571085810688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (283us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788684251.614619:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788684251.614774:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648602a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6501:1875571085810688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788684251.614809:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788684251.615280:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.615291:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.615299:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.615306:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684251.615311:0:6501:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.615320:0:6501:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.615338:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6647580900) 00010000:00010000:1.0:1788684251.615341:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788684251.615347:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.615354:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ace04 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788684251.615515:0:6501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788684251.619533:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788684251.619587:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332613220259ns, next at 333613213938ns, rc = 0 00000001:00080000:1.0:1788684251.619607:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:1.0:1788684251.619670:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6647580900) 00010000:00010000:1.0:1788684251.619674:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788684251.619685:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54acdef lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c83 expref: 35 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684251.619834:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749555850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+34:12221:x1875571073165952:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 14112us (14807us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788684251.619844:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 38 00000020:00080000:1.0:1788684251.619850:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788684251.636600:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.636706:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073166208 00000100:00100000:1.0:1788684251.636715:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073166208 00000100:00100000:1.0:1788684251.636775:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 162 00000100:00100000:1.0:1788684251.636784:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+34:12221:x1875571073166208:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684251.636806:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684251.636935:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ace0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c8a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.637001:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ace0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c8a expref: 35 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.637016:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ace0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c8a expref: 35 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.637035:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684251.637039:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684251.637043:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1e00, rc 0) 00000100:00100000:1.0:1788684251.637105:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:12221:x1875571073166208:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 322us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684251.637113:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 162 00000100:00100000:0.0:1788684251.654526:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684251.665608:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073166464 00000100:00100000:3.0:1788684251.665624:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073166464 00000100:00100000:2.0:1788684251.666037:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:2.0:1788684251.666049:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:12221:x1875571073166464:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684251.666285:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+36:12221:x1875571073166464:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 238us (11766us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788684251.666294:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:0.0:1788684251.769416:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684251.770012:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073166720 00000100:00100000:2.0:1788684251.770027:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073166720 00000100:00100000:2.0:1788684251.770193:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 163 00000100:00100000:2.0:1788684251.770207:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+36:12231:x1875571073166720:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684251.770239:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684251.770267:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ace12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c91 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684251.771231:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788684251.771396:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ace12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c91 expref: 38 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684251.771414:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647580f00) 00010000:00010000:3.0:1788684251.771417:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684251.771613:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ace12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c91 expref: 38 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684251.771755:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5200, rc 0) 00000100:00100000:3.0:1788684251.772025:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:12231:x1875571073166720:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1820us (2620us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1788684251.772036:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 163 00000100:00100000:3.0:1788684251.785264:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00010000:00010000:2.0:1788684251.785488:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684251.785505:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073166848 00000100:00100000:2.0:1788684251.785516:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073166848 00000100:00100000:2.0:1788684251.785587:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:2.0:1788684251.785597:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:12231:x1875571073166848:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:2.0:1788684251.785719:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785739:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785751:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785761:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785768:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785774:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785852:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785860:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785865:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684251.785931:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785947:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785964:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785971:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785978:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684251.785984:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.785993:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786006:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684251.786009:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684251.786014:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786020:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace20 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786034:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786040:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786046:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786051:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684251.786057:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786064:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786351:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580200) 00010000:00010000:2.0:1788684251.786354:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684251.786357:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786517:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786531:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786536:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786541:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786545:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684251.786548:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786564:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786573:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684251.786575:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684251.786586:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684251.786593:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ace2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684251.786729:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:12231:x1875571073166848:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 1130us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684251.786740:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:2.0:1788684251.790057:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684251.790270:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073167104 00000100:00100000:3.0:1788684251.790282:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073167104 00000100:00100000:3.0:1788684251.793718:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:3.0:1788684251.793762:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:12231:x1875571073167104:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1788684251.795629:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:12231:x1875571073167104:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 1877us (5571us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788684251.796602:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:2.0:1788684251.877054:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.877186:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073167360 00000100:00100000:1.0:1788684251.877200:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073167360 00000100:00100000:1.0:1788684251.877302:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 165 00000100:00100000:1.0:1788684251.877314:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:12234:x1875571073167360:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684251.877352:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684251.877435:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ace35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c98 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.877566:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.877588:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.877601:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.877613:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.877621:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.877628:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.877969:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.877980:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.877988:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684251.877998:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788684251.878861:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878873:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878880:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878886:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684251.878890:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878898:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878912:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:0.0:1788684251.878915:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684251.878920:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878926:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ace3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878942:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878948:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878954:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878973:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684251.878976:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878981:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878987:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580200) 00010000:00010000:0.0:1788684251.878989:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684251.878992:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.878997:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ace43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.879125:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ace35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c98 expref: 41 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.879144:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c98 expref: 40 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684251.879152:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684251.879155:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684251.879158:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890400, rc 0) 00000100:00100000:0.0:1788684251.879245:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+40:12234:x1875571073167360:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1933us (2207us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788684251.879255:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 165 00000100:00100000:3.0:1788684251.883141:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.883278:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073167488 00000100:00100000:1.0:1788684251.883290:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073167488 00000100:00100000:1.0:1788684251.883818:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:1.0:1788684251.883835:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+40:12234:x1875571073167488:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:1.0:1788684251.883937:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.883983:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.883998:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.884047:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.884057:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.884065:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.884071:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684251.884076:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.884085:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.884099:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684251.884103:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684251.884108:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684251.884115:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ace58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684251.884258:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+40:12234:x1875571073167488:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 427us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684251.884276:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:3.0:1788684251.892756:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684251.893000:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073167744 00000100:00100000:1.0:1788684251.893013:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073167744 00000100:00100000:1.0:1788684251.893085:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:1.0:1788684251.893194:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+40:12234:x1875571073167744:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684251.893830:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+41:12234:x1875571073167744:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 731us (1084us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788684251.893840:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:2.0:1788684252.136248:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684252.136467:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073168000 00000100:00100000:3.0:1788684252.136480:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073168000 00000100:00100000:3.0:1788684252.136565:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 167 00000100:00100000:3.0:1788684252.136577:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+41:12265:x1875571073168000:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:3.0:1788684252.136611:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684252.136649:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3c9f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.136971:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.136989:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.137005:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684252.137018:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788684252.137163:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c9f expref: 44 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.137185:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c9f expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.137208:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684252.137211:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684252.137216:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c000, rc 0) 00000100:00100000:3.0:1788684252.137560:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:12265:x1875571073168000:12345-192.168.206.44@tcp:101:cat.0 Request processed in 976us (1336us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788684252.137569:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 167 00000100:00100000:3.0:1788684252.142466:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.142656:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073168256 00000100:00100000:2.0:1788684252.142670:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073168256 00000100:00100000:2.0:1788684252.142750:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:2.0:1788684252.142763:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:12265:x1875571073168256:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:2.0:1788684252.143093:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:12265:x1875571073168256:12345-192.168.206.44@tcp:35:cat.0 Request processed in 332us (644us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788684252.143101:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:1.0:1788684252.149510:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.149680:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073168384 00000100:00100000:2.0:1788684252.149693:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073168384 00000100:00100000:2.0:1788684252.149785:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:2.0:1788684252.149797:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:2391:x1875571073168384:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684252.149816:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684252.149847:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c9f expref: 44 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.149871:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684252.149896:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684252.149971:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:2391:x1875571073168384:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 175us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684252.149980:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:0.0:1788684252.220240:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.220467:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073168640 00000100:00100000:2.0:1788684252.220481:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073168640 00000100:00100000:2.0:1788684252.220564:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 168 00000100:00100000:2.0:1788684252.220576:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:12271:x1875571073168640:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:2.0:1788684252.220607:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684252.220611:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788684252.220655:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54acdcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c75 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.220678:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684252.220684:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684252.220700:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace74 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ca6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.220828:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.220843:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c98 expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.220853:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.220890:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c98 expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.220917:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c98 expref: 43 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684252.220933:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875571085810816:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684252.221047:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788684252.227941:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684252.228098:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073168768 00000100:00100000:1.0:1788684252.228110:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073168768 00010000:00010000:1.0:1788684252.228162:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c98 expref: 44 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684252.228219:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00100000:1.0:1788684252.228240:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6748348850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:2392:x1875571073168768:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684252.228263:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684252.228271:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c98 expref: 44 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.228293:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c98 expref: 44 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.228328:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684252.228335:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.228415:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.228438:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.228468:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684252.228567:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6748348850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:2392:x1875571073168768:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 336us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684252.228576:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 83 00010000:00010000:2.0:1788684252.228981:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ace4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c98 expref: 43 pid: 6499 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684252.229000:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875571085810816:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684252.229024:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.229034:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.229040:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684252.229062:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788684252.229279:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ca6 expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.229298:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ca6 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.229307:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684252.229331:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788684252.229335:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4c00, rc 0) 00000100:00100000:2.0:1788684252.229438:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:12271:x1875571073168640:12345-192.168.206.44@tcp:101:dd.0 Request processed in 8864us (9225us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788684252.229445:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 168 00000100:00100000:1.0:1788684252.234014:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684252.234326:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073168896 00000100:00100000:3.0:1788684252.234339:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073168896 00000100:00100000:3.0:1788684252.234713:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 169 00000100:00100000:3.0:1788684252.234726:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:12271:x1875571073168896:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:3.0:1788684252.234763:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684252.234799:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cad expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.234841:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.234859:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.234871:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.235066:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cad expref: 45 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.235106:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cad expref: 44 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.235132:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684252.235136:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788684252.235140:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c000, rc 0) 00000100:00100000:3.0:1788684252.235592:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:12271:x1875571073168896:12345-192.168.206.44@tcp:101:dd.0 Request processed in 867us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684252.235609:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 169 00000100:00100000:1.0:1788684252.240952:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684252.241064:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073169152 00000100:00100000:3.0:1788684252.241076:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073169152 00000100:00100000:3.0:1788684252.241479:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 170 00000100:00100000:3.0:1788684252.241492:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:12271:x1875571073169152:12345-192.168.206.44@tcp:36:dd.0 00010000:00010000:3.0:1788684252.241797:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.241818:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.241832:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788684252.241885:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788684252.241914:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e5db0ba reply state 00000000246afb9d transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.241928:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.241975:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684252.241979:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788684252.241984:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788684252.242822:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+47:12271:x1875571073169152:12345-192.168.206.44@tcp:36:dd.0 Request processed in 1327us (1880us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788684252.242834:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 170 00000020:00080000:3.0:1788684252.242842:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788684252.543912:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.544043:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073169280 00000100:00100000:2.0:1788684252.544056:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073169280 00000100:00100000:2.0:1788684252.544135:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 171 00000100:00100000:2.0:1788684252.544146:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+47:12285:x1875571073169280:12345-192.168.206.44@tcp:101:stat.0 00010000:00010000:2.0:1788684252.544175:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684252.544202:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cb4 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544298:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544316:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544329:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544341:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544348:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544355:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544506:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544519:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ca6 expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544529:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544579:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ca6 expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.544596:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ca6 expref: 48 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684252.544611:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085810944:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684252.544745:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684252.552581:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085810944:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684252.552625:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684252.554135:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.554413:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073169536 00000100:00100000:2.0:1788684252.554425:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073169536 00000100:00100000:2.0:1788684252.554498:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:2.0:1788684252.554509:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+49:6159:x1875571073169536:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788684252.555040:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+50:6159:x1875571073169536:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 529us (913us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1788684252.555069:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:1.0:1788684252.564639:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.564725:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073169664 00000100:00100000:2.0:1788684252.564737:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073169664 00010000:00010000:2.0:1788684252.564802:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ca6 expref: 50 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684252.564848:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 84 00000100:00100000:2.0:1788684252.564859:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+50:2392:x1875571073169664:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684252.564878:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684252.564886:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ca6 expref: 50 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.564902:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ca6 expref: 50 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.564929:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ace7b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ca6 expref: 50 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.564948:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684252.564955:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.564966:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.564975:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.565037:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788684252.565096:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565108:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684252.565181:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788684252.565187:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1788684252.565208:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+49:2392:x1875571073169664:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 348us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684252.565217:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 84 00000004:00010000:0.0:1788684252.565219:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565237:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565250:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565258:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565276:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565284:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684252.565289:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565298:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565309:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:0.0:1788684252.565321:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684252.565327:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565333:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54acea5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565345:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565352:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565358:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565363:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684252.565415:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565423:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565432:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580200) 00010000:00010000:0.0:1788684252.565435:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684252.565437:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565443:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54aceac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565480:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ace9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cb4 expref: 49 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565509:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cb4 expref: 48 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684252.565517:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684252.565520:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684252.565522:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5a00, rc 0) 00000100:00100000:0.0:1788684252.565564:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+48:12285:x1875571073169280:12345-192.168.206.44@tcp:101:stat.0 Request processed in 21420us (21667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684252.565572:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 171 00000100:00100000:3.0:1788684252.622257:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684252.622353:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073169920 00000100:00100000:1.0:1788684252.622402:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073169920 00000100:00100000:1.0:1788684252.622485:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 172 00000100:00100000:1.0:1788684252.622515:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+48:12291:x1875571073169920:12345-192.168.206.44@tcp:36:truncate.0 00010000:00010000:1.0:1788684252.622613:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684252.622654:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54aceb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cb4 expref: 48 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.622679:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684252.622685:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684252.622898:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.622917:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.622948:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788684252.623000:0:13784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:1.0:1788684252.623023:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ad97478 reply state 00000000d24c7c00 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.623037:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684252.623044:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684252.623047:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684252.623050:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788684252.623177:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+50:12291:x1875571073169920:12345-192.168.206.44@tcp:36:truncate.0 Request processed in 682us (936us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788684252.623186:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 172 00000020:00080000:1.0:1788684252.623192:0:13784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788684252.786855:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.788027:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073170048 00000100:00100000:2.0:1788684252.788045:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073170048 00000100:00100000:2.0:1788684252.788124:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 173 00000100:00100000:2.0:1788684252.788138:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+50:12305:x1875571073170048:12345-192.168.206.44@tcp:101:stat.0 00010000:00010000:2.0:1788684252.788168:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684252.788194:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acec1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cbb expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788283:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788301:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788315:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788328:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788336:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788343:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788852:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788863:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788871:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684252.788925:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788684252.788931:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684252.788957:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788971:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788980:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788987:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.788994:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789001:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684252.789006:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789015:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789040:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684252.789043:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684252.789049:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789055:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acec8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789069:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789075:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789081:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789086:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684252.789089:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789095:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789103:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580200) 00010000:00010000:2.0:1788684252.789105:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684252.789108:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789113:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acecf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789157:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acec1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cbb expref: 52 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789170:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cbb expref: 51 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684252.789179:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684252.789181:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684252.789184:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4200, rc 0) 00000100:00100000:2.0:1788684252.790599:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+51:12305:x1875571073170048:12345-192.168.206.44@tcp:101:stat.0 Request processed in 2450us (3746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684252.790614:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 173 00010000:00010000:0.0:1788684252.798067:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684252.857866:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.857917:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.857959:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684252.857989:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684252.857997:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073170176 00000100:00100000:2.0:1788684252.858007:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684252.858009:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073170176 00000100:00100000:2.0:1788684252.858034:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684252.858069:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 385 00000100:00100000:3.0:1788684252.858080:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073170176:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684252.858082:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073170432 00000100:00100000:2.0:1788684252.858085:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073170432 00000100:00100000:2.0:1788684252.858112:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073170560 00000100:00100000:2.0:1788684252.858114:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073170560 00000100:00100000:2.0:1788684252.858142:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00100000:2.0:1788684252.858147:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073170432:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684252.858165:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2393:x1875571073170176:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684252.858173:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 385 00000100:00100000:2.0:1788684252.858175:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073170432:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684252.858202:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00100000:2.0:1788684252.858218:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00100000:2.0:1788684252.858223:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073170560:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684252.858249:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073170560:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684252.858254:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00100000:3.0:1788684252.858350:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073170688 00000100:00100000:1.0:1788684252.858351:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073170304 00000100:00100000:3.0:1788684252.858354:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073170688 00000100:00100000:1.0:1788684252.858354:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073170304 00000100:00100000:3.0:1788684252.858407:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073170816 00000100:00100000:3.0:1788684252.858410:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073170816 00000100:00100000:1.0:1788684252.858419:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 301 00000100:00100000:1.0:1788684252.858426:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073170688:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684252.858441:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 302 00000100:00100000:3.0:1788684252.858447:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073170304:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684252.858464:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073170688:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 39us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684252.858467:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073170304:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 21us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684252.858471:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 301 00000100:00100000:3.0:1788684252.858474:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 302 00000100:00100000:1.0:1788684252.858482:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 303 00000100:00100000:1.0:1788684252.858488:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073170816:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684252.858528:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2393:x1875571073170816:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 40us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684252.858541:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 303 00000100:00080000:0.0:1788684252.858895:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684252.858902:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684252.902076:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684252.902230:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073171072 00000100:00100000:3.0:1788684252.902260:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073171072 00000100:00100000:3.0:1788684252.902348:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 174 00000100:00100000:3.0:1788684252.902481:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+51:12316:x1875571073171072:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684252.902508:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684252.902533:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acedd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cc2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684252.902644:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788684252.902744:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acedd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc2 expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.902760:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647580f00) 00010000:00010000:3.0:1788684252.902763:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684252.902769:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54acedd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc2 expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.902782:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711ca00, rc 0) 00000100:00100000:3.0:1788684252.903079:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:12316:x1875571073171072:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 720us (1016us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1788684252.903090:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 174 00000100:00100000:3.0:1788684252.912083:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684252.915089:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073171328 00000100:00100000:1.0:1788684252.915286:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073171328 00000100:00100000:1.0:1788684252.915496:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:1.0:1788684252.915875:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749554050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:12316:x1875571073171328:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684252.916705:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749554050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+53:12316:x1875571073171328:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 823us (4617us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788684252.918425:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:0.0:1788684252.998431:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684252.998519:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073171584 00000100:00100000:3.0:1788684252.998529:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073171584 00000100:00100000:3.0:1788684252.998594:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 175 00000100:00100000:3.0:1788684252.998605:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+53:12322:x1875571073171584:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684252.998629:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684252.998652:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54aceeb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cc9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.998761:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.998789:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cbb expref: 54 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.998798:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.998830:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cbb expref: 54 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684252.998844:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cbb expref: 54 pid: 7963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684252.998857:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648554700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085811072:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684252.998964:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684253.001671:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648554700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085811072:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684253.001699:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684253.005269:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684253.005469:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073171712 00000100:00100000:1.0:1788684253.005477:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073171712 00010000:00010000:1.0:1788684253.005527:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cbb expref: 55 pid: 7963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684253.005578:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 85 00000100:00100000:1.0:1788684253.005587:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+55:2392:x1875571073171712:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684253.005600:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684253.005607:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cbb expref: 55 pid: 7963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.005619:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cbb expref: 55 pid: 7963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.005639:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54aced6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cbb expref: 55 pid: 7963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.005655:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684253.005671:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.005681:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.005688:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.005711:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684253.005757:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:2392:x1875571073171712:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 171us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684253.005763:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 85 00000100:00080000:0.0:1788684253.006390:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788684253.006407:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.006416:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684253.006436:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788684253.006576:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54aceeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc9 expref: 55 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.006601:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc9 expref: 54 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.006608:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684253.006611:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788684253.006613:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d600, rc 0) 00000100:00100000:0.0:1788684253.006657:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:12322:x1875571073171584:12345-192.168.206.44@tcp:101:bash.0 Request processed in 8055us (8235us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788684253.006665:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 175 00000100:00100000:0.0:1788684253.013025:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.013119:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073171968 00000100:00100000:2.0:1788684253.013128:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073171968 00000100:00100000:2.0:1788684253.013188:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 176 00000100:00100000:2.0:1788684253.013198:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:12322:x1875571073171968:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:2.0:1788684253.013441:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.013458:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.013471:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684253.013511:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:2.0:1788684253.013532:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e25c647 reply state 00000000e2c5e087 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.013564:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.013572:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684253.013588:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684253.013592:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684253.013684:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:12322:x1875571073171968:12345-192.168.206.44@tcp:36:bash.0 Request processed in 486us (665us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788684253.013692:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 176 00000020:00080000:2.0:1788684253.013697:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788684253.022933:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.023136:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073172096 00000100:00100000:2.0:1788684253.023145:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073172096 00000100:00100000:2.0:1788684253.023201:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 177 00000100:00100000:2.0:1788684253.023211:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:12322:x1875571073172096:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684253.023233:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684253.023253:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cd0 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.023361:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.023398:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc9 expref: 58 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.023406:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.023437:0:7963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc9 expref: 58 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.023449:0:7963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc9 expref: 58 pid: 6497 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684253.023462:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085811200:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684253.023611:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684253.031230:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085811200:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684253.031263:0:7963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684253.034344:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.036288:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073172224 00000100:00100000:2.0:1788684253.036303:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073172224 00010000:00010000:2.0:1788684253.036357:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc9 expref: 59 pid: 6497 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684253.036444:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:2.0:1788684253.036455:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:2393:x1875571073172224:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684253.036470:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684253.036477:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc9 expref: 59 pid: 6497 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.036490:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc9 expref: 59 pid: 6497 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.036511:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acef2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cc9 expref: 59 pid: 6497 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.036529:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684253.036534:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.036543:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.036580:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.036618:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684253.036687:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:2393:x1875571073172224:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 234us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684253.036695:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 86 00010000:00010000:3.0:1788684253.036786:0:7963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.036794:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684253.036853:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788684253.036858:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684253.036877:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.036912:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cd0 expref: 58 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.036926:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cd0 expref: 57 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.036933:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684253.036935:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684253.036938:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4a00, rc 0) 00000100:00100000:3.0:1788684253.036961:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:12322:x1875571073172096:12345-192.168.206.44@tcp:101:bash.0 Request processed in 13753us (14038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684253.036967:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 177 00000100:00100000:1.0:1788684253.042991:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684253.047493:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073172480 00000100:00100000:3.0:1788684253.047508:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073172480 00000100:00100000:3.0:1788684253.047609:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:3.0:1788684253.047620:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+57:12322:x1875571073172480:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:3.0:1788684253.048019:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:12322:x1875571073172480:12345-192.168.206.44@tcp:35:bash.0 Request processed in 399us (5034us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788684253.048027:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:0.0:1788684253.131846:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684253.131948:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073172736 00000100:00100000:1.0:1788684253.131957:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073172736 00000100:00100000:1.0:1788684253.132019:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 178 00000100:00100000:1.0:1788684253.132029:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:12332:x1875571073172736:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684253.132051:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684253.132070:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cd7 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684253.132360:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788684253.132481:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cd7 expref: 60 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.132497:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647580f00) 00010000:00010000:1.0:1788684253.132500:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684253.132506:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cd7 expref: 60 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.132526:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1000, rc 0) 00000100:00100000:1.0:1788684253.132595:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:12332:x1875571073172736:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 568us (757us total) trans 4294967454 rc 301/301 00000100:00100000:1.0:1788684253.132603:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 178 00000100:00100000:0.0:1788684253.142956:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.143114:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073172864 00000100:00100000:2.0:1788684253.143123:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073172864 00000100:00100000:2.0:1788684253.143199:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 179 00000100:00100000:2.0:1788684253.143210:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:12332:x1875571073172864:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:2.0:1788684253.143288:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143306:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143317:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143328:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143335:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143342:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143454:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143477:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143484:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684253.143536:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143561:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143569:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143576:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143583:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684253.143588:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143596:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143609:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684253.143612:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684253.143617:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143623:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143644:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143651:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143658:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143663:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684253.143666:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143672:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143679:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580200) 00010000:00010000:2.0:1788684253.143682:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684253.143685:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143691:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143699:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143704:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143710:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143720:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684253.143724:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143729:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143736:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684253.143738:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684253.143740:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.143745:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684253.143810:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:12332:x1875571073172864:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 601us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684253.143818:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 179 00000100:00100000:0.0:1788684253.145751:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.145825:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073173120 00000100:00100000:2.0:1788684253.145833:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073173120 00000100:00100000:2.0:1788684253.145884:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:2.0:1788684253.145893:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:12332:x1875571073173120:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684253.146222:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:12332:x1875571073173120:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 329us (478us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788684253.146230:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:0.0:1788684253.186579:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684253.186667:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073173376 00000100:00100000:3.0:1788684253.186686:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073173376 00000100:00100000:3.0:1788684253.186784:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 180 00000100:00100000:3.0:1788684253.186797:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:12335:x1875571073173376:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684253.186831:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684253.186860:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acf38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cde expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.186979:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.186997:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187010:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187023:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187031:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187039:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187200:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54acf4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187211:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54acf4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187219:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54acf4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684253.187230:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788684253.187334:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187342:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187357:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187883:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684253.187892:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187902:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187918:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:3.0:1788684253.187922:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684253.187927:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187935:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187954:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187962:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187968:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187974:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684253.187977:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.187996:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.188006:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580200) 00010000:00010000:3.0:1788684253.188008:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684253.188012:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.188019:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.188075:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acf38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cde expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.188091:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54acf4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cde expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.188099:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684253.188101:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684253.188104:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711de00, rc 0) 00000100:00100000:3.0:1788684253.189195:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:12335:x1875571073173376:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 2391us (2616us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788684253.189207:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 180 00000100:00100000:0.0:1788684253.193975:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684253.194091:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073173504 00000100:00100000:1.0:1788684253.194107:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073173504 00000100:00100000:1.0:1788684253.194187:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00100000:1.0:1788684253.194198:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:12335:x1875571073173504:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:1.0:1788684253.194264:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.194280:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.194292:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.194327:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.194335:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.194342:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.194347:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684253.194352:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.194843:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.194865:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684253.194869:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684253.194873:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.194880:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54acf5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684253.194982:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:12335:x1875571073173504:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 784us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684253.194991:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00100000:3.0:1788684253.195538:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684253.196445:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073173632 00000100:00100000:1.0:1788684253.196457:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073173632 00000100:00100000:1.0:1788684253.196558:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:1.0:1788684253.196570:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:2391:x1875571073173632:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684253.196585:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684253.196618:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54acf4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cde expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.196640:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684253.196648:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684253.196714:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:2391:x1875571073173632:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 147us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684253.196726:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:3.0:1788684253.199084:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.199220:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073173888 00000100:00100000:2.0:1788684253.199232:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073173888 00000100:00100000:2.0:1788684253.199313:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:2.0:1788684253.199349:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:12335:x1875571073173888:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684253.199878:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:12335:x1875571073173888:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 530us (805us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788684253.199887:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:0.0:1788684253.352830:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.352951:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073174144 00000100:00100000:2.0:1788684253.352964:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073174144 00000100:00100000:2.0:1788684253.353094:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:2.0:1788684253.353115:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:12353:x1875571073174144:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:2.0:1788684253.353148:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684253.353175:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ce5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.353331:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf69 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.353395:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.353409:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684253.353422:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788684253.353587:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ce5 expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.353609:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ce5 expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.353643:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684253.353646:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788684253.353650:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684253.353717:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12353:x1875571073174144:12345-192.168.206.44@tcp:101:cat.0 Request processed in 605us (903us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788684253.353725:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:0.0:1788684253.375773:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.375882:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073174272 00000100:00100000:2.0:1788684253.375894:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073174272 00000100:00100000:2.0:1788684253.375966:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:2.0:1788684253.375979:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12354:x1875571073174272:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684253.376011:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684253.376040:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cec expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.376139:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.376156:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.376168:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684253.376220:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788684253.376224:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684253.376246:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.376309:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54acf77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cec expref: 66 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.376331:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cec expref: 65 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.376341:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684253.376344:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684253.376348:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4e00, rc 0) 00000100:00100000:2.0:1788684253.376476:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12354:x1875571073174272:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 500us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684253.376485:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:0.0:1788684253.383688:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.383920:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073174656 00000100:00100000:2.0:1788684253.383934:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073174656 00000100:00100000:2.0:1788684253.384017:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:2.0:1788684253.384031:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12354:x1875571073174656:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:0.0:1788684253.393059:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12354:x1875571073174656:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 9016us (9370us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788684253.393085:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:0.0:1788684253.402694:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.402853:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073174784 00000100:00100000:2.0:1788684253.402866:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073174784 00000100:00100000:2.0:1788684253.402949:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:2.0:1788684253.402962:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12354:x1875571073174784:12345-192.168.206.44@tcp:103:lfs.0 00010000:00010000:2.0:1788684253.402983:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788684253.403014:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acf0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cd0 expref: 66 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.403041:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acf69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ce5 expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.403086:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ace0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c8a expref: 64 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.403107:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684253.403113:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684253.403184:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:12354:x1875571073174784:12345-192.168.206.44@tcp:103:lfs.0 Request processed in 224us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684253.403192:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:1.0:1788684253.406568:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684253.407218:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073174912 00000100:00100000:0.0:1788684253.407243:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073174912 00000100:00100000:0.0:1788684253.407325:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:0.0:1788684253.407337:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:12354:x1875571073174912:12345-192.168.206.44@tcp:58:lfs.0 00010000:00010000:0.0:1788684253.407543:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.407575:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.407588:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684253.408107:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788684253.408561:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:12354:x1875571073174912:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 1213us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684253.408572:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:1.0:1788684253.439879:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684253.440088:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073175040 00000100:00100000:3.0:1788684253.440101:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073175040 00000100:00100000:3.0:1788684253.440301:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 185 00000100:00100000:3.0:1788684253.440333:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:12356:x1875571073175040:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684253.440358:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684253.440424:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acf8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cf3 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440511:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440529:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440543:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440567:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440575:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440582:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440671:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440681:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440689:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684253.440768:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788684253.440774:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684253.440797:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440811:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440819:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440826:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440832:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440838:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684253.440843:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440852:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440866:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:3.0:1788684253.440870:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684253.440874:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440880:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54acf93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440908:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440915:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440921:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440926:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684253.440929:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440935:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440943:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580200) 00010000:00010000:3.0:1788684253.440946:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684253.440949:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440954:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acf9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.440985:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acf8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cf3 expref: 65 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.441000:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cf3 expref: 64 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.441031:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684253.441034:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788684253.441037:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d600, rc 0) 00000100:00100000:3.0:1788684253.441120:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12356:x1875571073175040:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 789us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684253.441128:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 185 00010000:00010000:3.0:1788684253.823058:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788684253.829003:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684253.829013:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684253.829063:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788684253.829072:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684253.829635:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085811328:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788684253.829811:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684253.838050:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085811328:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788684253.838356:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.838587:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073175168 00000100:00100000:2.0:1788684253.838597:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073175168 00000100:00100000:2.0:1788684253.838687:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:2.0:1788684253.838700:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12367:x1875571073175168:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788684253.838739:0:7963:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788684253.838887:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12367:x1875571073175168:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 189us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684253.838897:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:3.0:1788684253.842598:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684253.842794:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073175296 00000100:00100000:0.0:1788684253.842807:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073175296 00000100:00100000:0.0:1788684253.842883:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:0.0:1788684253.842902:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12367:x1875571073175296:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788684253.842997:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.843018:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.843040:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.845792:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.845818:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.845832:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.845881:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.845892:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.845901:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684253.845952:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788684253.845957:0:13784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684253.845971:0:13784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.845984:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.845991:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846017:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846024:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684253.846029:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846038:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846050:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:0.0:1788684253.846054:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684253.846058:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846064:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54acfa8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846082:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846087:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846093:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846098:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684253.846101:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846118:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846129:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8d6750bd9500) 00010000:00010000:0.0:1788684253.846132:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684253.846136:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846142:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54acfaf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846164:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846171:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846177:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846184:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684253.846188:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846194:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846205:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684253.846207:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684253.846211:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.846228:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acfb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684253.846505:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12367:x1875571073175296:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 3609us (3917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684253.846518:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:1.0:1788684253.860066:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.860840:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073175552 00000100:00100000:2.0:1788684253.860854:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073175552 00000100:00100000:2.0:1788684253.860937:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 188 00000100:00100000:2.0:1788684253.860948:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12367:x1875571073175552:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684253.860977:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684253.861002:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acfbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3cfa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.861147:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.861175:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.861189:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684253.861204:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788684253.863198:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.863230:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.863239:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.863246:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684253.863251:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.863261:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.863288:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684253.863292:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684253.863298:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.863305:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54acfc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.863382:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acfbd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cfa expref: 66 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.863403:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:2.0:1788684253.863406:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788684253.863410:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acfbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cfa expref: 66 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.863421:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684253.863515:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12367:x1875571073175552:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 2568us (3462us total) trans 4294967460 rc 301/301 00000100:00100000:2.0:1788684253.863525:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 188 00000100:00100000:3.0:1788684253.870139:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.870555:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073175680 00000100:00100000:2.0:1788684253.870568:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073175680 00000100:00100000:2.0:1788684253.870639:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 189 00000100:00100000:2.0:1788684253.870652:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12367:x1875571073175680:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788684253.870697:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788684253.870855:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12367:x1875571073175680:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 205us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684253.870864:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 189 00000001:00080000:2.0:1788684253.872736:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1788684253.872816:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788684253.872847:0:6476:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d67771d9e40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788684253.872853:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6777040300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d67771d9240 00000020:00080000:2.0:1788684253.872857:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6777040b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d6647998a00 00000020:00080000:2.0:1788684253.872899:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788684253.872980:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788684253.873231:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085811456:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788684253.873311:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684253.873407:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085811456 00000100:00100000:3.0:1788684253.873426:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085811456 00000100:00100000:3.0:1788684253.873486:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788684253.873495:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085811456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788684253.873525:0:9991:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1788684253.873589:0:9991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9d27db, atime: 0x6a9d27db, ctime: 0x6a9d27db, blocks: 0x8 00010000:00010000:3.0:1788684253.873598:0:9991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.873617:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1788684253.873622:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684253.873630:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.873663:0:9991:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.873675:0:9991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.873683:0:9991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.873704:0:9991:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788684253.874040:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085811456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 545us (727us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788684253.874050:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788684253.874077:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788684253.874094:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684253.874101:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.874110:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684253.874116:0:6485:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.874127:0:6485:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.874161:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.874170:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54acfd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.874202:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684253.874205:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684253.874208:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788684253.874246:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d6648557800/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788684253.874253:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085811456:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788684253.874693:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874706:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874714:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874719:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684253.874725:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874732:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874747:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d6641867e00) 00010000:00010000:1.0:1788684253.874751:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684253.874756:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874840:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54acd4e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874865:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874872:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874892:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874897:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684253.874901:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874908:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874918:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:1.0:1788684253.874921:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684253.874924:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874931:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54acd55 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874947:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874954:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874961:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874967:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684253.874970:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874987:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.874997:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580200) 00010000:00010000:1.0:1788684253.874999:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684253.875003:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875010:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54acd94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875030:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875037:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875044:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875049:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684253.875052:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875058:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875066:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684253.875069:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684253.875072:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875089:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ace97 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875103:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875693:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875705:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875711:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684253.875714:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875720:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875729:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684253.875731:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684253.875734:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875740:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54aceba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875751:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.875757:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.876205:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.876212:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684253.876215:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.876222:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.876232:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684253.876235:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684253.876238:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.876243:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54acf00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684253.881809:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684253.881908:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073175936 00000100:00100000:1.0:1788684253.881921:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073175936 00000100:00100000:1.0:1788684253.881988:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 190 00000100:00100000:1.0:1788684253.882000:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:12367:x1875571073175936:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684253.882033:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684253.882038:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788684253.882078:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54acf7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cec expref: 17 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684253.882101:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:1.0:1788684253.882108:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684253.882150:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54acfd9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788684253.883810:0:6497:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788684253.884030:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acfe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.884052:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acfe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.884064:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acfe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.884140:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54acfd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d01 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.884162:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acfe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d01 expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.884172:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6647580800) 00010000:00010000:2.0:1788684253.884175:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684253.884178:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684253.884440:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:12367:x1875571073175936:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 2439us (2641us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788684253.884450:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 190 00000100:00100000:3.0:1788684253.894957:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684253.895006:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073176192 00000100:00100000:3.0:1788684253.895018:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073176192 00000100:00100000:3.0:1788684253.895080:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:3.0:1788684253.895105:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:12367:x1875571073176192:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788684253.895188:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684253.895238:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54acfe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d01 expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895271:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6647580800) 00010000:00010000:3.0:1788684253.895287:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788684253.895322:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895341:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895402:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895451:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895461:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895468:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895527:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895535:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895553:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895560:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684253.895565:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895574:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895583:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:3.0:1788684253.895586:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684253.895590:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895604:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54acfee lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895615:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895623:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895630:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895636:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684253.895640:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895658:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895668:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8c26389d (ffff8d6750b6f400) 00010000:00010000:3.0:1788684253.895670:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684253.895673:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.895679:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54acff5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8c26389d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684253.895795:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:12367:x1875571073176192:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 704us (850us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788684253.895804:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:2.0:1788684253.899690:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684253.900054:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073176320 00000100:00100000:0.0:1788684253.900066:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073176320 00000100:00100000:0.0:1788684253.900195:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:0.0:1788684253.900207:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+17:12367:x1875571073176320:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684253.900244:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684253.900603:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acffc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d08 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.900663:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.900679:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.900692:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.900837:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54acffc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d08 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.900859:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d08 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.900881:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:0.0:1788684253.900885:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788684253.900889:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890e00, rc 0) 00000100:00100000:0.0:1788684253.900964:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:12367:x1875571073176320:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 759us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684253.900972:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:1.0:1788684253.914622:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684253.915812:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073176576 00000100:00100000:2.0:1788684253.915829:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073176576 00000100:00100000:2.0:1788684253.915898:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:2.0:1788684253.915909:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664799f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:12367:x1875571073176576:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788684253.916014:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.916041:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.916055:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788684253.918600:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788684253.918635:0:13784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334912268281ns, next at 335912262956ns, rc = 0 00000004:00010000:2.0:1788684253.918812:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002268d221 reply state 000000007c2a0114 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.918836:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684253.918846:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:2.0:1788684253.918850:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788684253.918854:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684253.919007:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664799f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:12367:x1875571073176576:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 3095us (4394us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1788684253.919019:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:0.0:1788684253.928078:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684253.928207:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073176704 00000100:00100000:3.0:1788684253.928220:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073176704 00000100:00100000:3.0:1788684253.928552:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:3.0:1788684253.928566:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:12367:x1875571073176704:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684253.928595:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684253.928621:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d0f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.928796:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d0f expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.928813:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d0f expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.928836:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:3.0:1788684253.928839:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788684253.928843:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d400, rc 0) 00000100:00100000:3.0:1788684253.928913:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12367:x1875571073176704:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 351us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684253.928921:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:2.0:1788684253.933745:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684253.933838:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073176832 00000100:00100000:0.0:1788684253.933851:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073176832 00000100:00100000:0.0:1788684253.933923:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:0.0:1788684253.933935:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073176832:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788684253.934206:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073176832:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 273us (471us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788684253.934215:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:2.0:1788684253.945275:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684253.945572:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073177088 00000100:00100000:3.0:1788684253.945586:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073177088 00000100:00100000:3.0:1788684253.945667:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:3.0:1788684253.945680:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12367:x1875571073177088:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788684253.945997:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:12367:x1875571073177088:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 318us (745us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788684253.946007:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:3.0:1788684253.956202:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684253.956329:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073177344 00000100:00100000:1.0:1788684253.956345:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073177344 00000100:00100000:1.0:1788684253.960807:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 195 00000100:00100000:1.0:1788684253.960830:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:12367:x1875571073177344:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788684253.960986:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:12367:x1875571073177344:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 165us (4799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684253.960996:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 195 00000100:00100000:1.0:1788684253.966632:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684253.966739:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073177472 00000100:00100000:3.0:1788684253.966752:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073177472 00000100:00100000:3.0:1788684253.966922:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:3.0:1788684253.966933:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:12367:x1875571073177472:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684253.966959:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684253.966987:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad018 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.967094:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad01f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.967112:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad01f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.967124:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad01f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684253.967181:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684253.967203:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad01f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.967846:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad018 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d16 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.967868:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad01f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d16 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684253.967878:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:3.0:1788684253.967882:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788684253.967896:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711cc00, rc 0) 00000100:00100000:3.0:1788684253.967978:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:12367:x1875571073177472:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1046us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684253.967988:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:2.0:1788684253.975077:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684253.977771:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073177600 00000100:00100000:0.0:1788684253.977791:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073177600 00000100:00100000:0.0:1788684253.977871:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:0.0:1788684253.977884:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073177600:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684253.977908:0:9991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684253.977932:0:9991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d1d expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684253.977962:0:9991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d27dd, blocks: 0x0 00010000:00010000:0.0:1788684253.977986:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1788684253.978318:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684253.978331:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d1d expref: 8 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.978354:0:9991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d1d expref: 8 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684253.978393:0:9991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890400, rc 0) 00000100:00100000:0.0:1788684253.978708:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073177600:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 825us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684253.978716:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:1.0:1788684253.983307:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684253.983625:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073177856 00000100:00100000:0.0:1788684253.983637:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073177856 00000100:00100000:0.0:1788684253.983699:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 197 00000100:00100000:0.0:1788684253.983710:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:12367:x1875571073177856:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788684253.983842:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:12367:x1875571073177856:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 133us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684253.983851:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 197 00000100:00100000:1.0:1788684254.001480:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.001599:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073177984 00000100:00100000:2.0:1788684254.001611:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073177984 00000100:00100000:2.0:1788684254.001691:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:2.0:1788684254.001703:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:12367:x1875571073177984:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684254.001729:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684254.001761:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d24 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.001801:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d1d expref: 9 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.001812:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684254.001816:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684254.001823:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.001863:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d1d expref: 9 pid: 9991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.001877:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d1d expref: 9 pid: 9991 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.001894:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8412:1875571085811584:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684254.001992:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4180 going to sleep for 11 seconds 00000100:00080000:3.0:1788684254.003095:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684254.008462:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8412:1875571085811584:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684254.008510:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.008921:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4000, rc 0) 00000100:00100000:1.0:1788684254.008945:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684254.008996:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:12367:x1875571073177984:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 7294us (7529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684254.009007:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:0.0:1788684254.012312:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073178112 00000100:00100000:0.0:1788684254.012339:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073178112 00010000:00010000:2.0:1788684254.012841:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d1d expref: 9 pid: 9991 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.012929:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:2.0:1788684254.012943:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2393:x1875571073178112:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684254.012963:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684254.012993:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d1d expref: 9 pid: 9991 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.013024:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d1d expref: 9 pid: 9991 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.013056:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd166f76/0x44bac02bd54ad026 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d1d expref: 9 pid: 9991 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.013074:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788684254.013079:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684254.013099:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.013110:0:9510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.013156:0:9510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.013173:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9510:1875571085811712:192.168.206.44@tcp:105: 00000100:00100000:2.0:1788684254.013309:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788684254.017153:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9510:1875571085811712:192.168.206.44@tcp:105: 00010000:00010000:2.0:1788684254.017190:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684254.017277:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2393:x1875571073178112:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 4337us (8332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.017291:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:3.0:1788684254.018641:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.018838:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073178240 00000100:00100000:1.0:1788684254.018850:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073178240 00002000:00100000:1.0:1788684254.018913:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d6648557480 x1875571073178240/t0(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:175/0 lens 504/0 e 0 to 0 dl 1788684265 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788684254.018926:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6648557480 with x1875571073178240 ext(0->8) 00002000:00010000:1.0:1788684254.018933:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6648557480 00000100:00100000:1.0:1788684254.019010:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:1.0:1788684254.019023:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073178240:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788684254.020942:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:2392:x1875571073178240:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 Request processed in 1907us (2296us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788684254.020958:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00002000:00100000:1.0:1788684254.021000:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8d6648557480 x1875571073178240/t4294967315(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:175/0 lens 504/448 e 0 to 0 dl 1788684265 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788684254.021012:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6648557480 with x1875571073178240 ext(0->8) 00002000:00010000:1.0:1788684254.021019:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6648557480 00000100:00100000:2.0:1788684254.026961:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.027062:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073178368 00000100:00100000:1.0:1788684254.027074:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073178368 00000100:00100000:1.0:1788684254.027178:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 198 00000100:00100000:1.0:1788684254.027190:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:12367:x1875571073178368:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788684254.035744:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:2.0:1788684254.035761:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788684254.035789:0:6476:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1788684254.035795:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.035809:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.035816:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.035837:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684254.035842:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.035850:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.035868:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:0.0:1788684254.035871:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788684254.035876:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.035882:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad00a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.035945:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:12367:x1875571073178368:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 8752us (8991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.035956:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 198 00000020:00080000:3.0:1788684254.036035:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788684254.036047:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788684254.036745:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085811840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788684254.036799:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684254.037536:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085811840 00000100:00100000:0.0:1788684254.037556:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085811840 00000100:00100000:0.0:1788684254.037746:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788684254.037755:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085811840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788684254.037874:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788684254.037878:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788684254 00002000:00010000:0.0:1788684254.037880:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788684254.037882:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788684253 -> 1788684254 00002000:00010000:0.0:1788684254.037884:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788684254.041866:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085811840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4103us (5057us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788684254.041880:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1788684254.043258:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d66459bf100/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788684254.043269:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085811840:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788684254.043293:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684254.043764:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.043875:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073178496 00000100:00100000:1.0:1788684254.043883:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073178496 00000100:00100000:1.0:1788684254.043983:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:1.0:1788684254.043995:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:2391:x1875571073178496:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788684254.049349:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788684254.049427:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1788684254.049903:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2391:x1875571073178496:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 5899us (6131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684254.049916:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:3.0:1788684254.057777:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.058274:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073178752 00000100:00100000:1.0:1788684254.058285:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073178752 00000100:00100000:1.0:1788684254.058343:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 199 00000100:00100000:1.0:1788684254.058362:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:12367:x1875571073178752:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788684254.058728:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684254.058756:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad01f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d16 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.058785:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:1.0:1788684254.058789:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684254.058830:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.058845:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.058854:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684254.059077:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a38333c reply state 0000000067f40f89 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.059089:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.059096:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:1.0:1788684254.059098:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684254.059101:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788684254.059202:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:12367:x1875571073178752:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 848us (1432us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1788684254.059210:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 199 00000100:00100000:2.0:1788684254.071956:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684254.072064:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073178880 00000100:00100000:0.0:1788684254.072091:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073178880 00000100:00100000:0.0:1788684254.072164:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:0.0:1788684254.072177:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073178880:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788684254.072430:0:9991:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788684254.072434:0:9991:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788684254 -> 1788684253 00002000:00010000:0.0:1788684254.072437:0:9991:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788684251 00002000:00010000:0.0:1788684254.072440:0:9991:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788684254 -> 1788684253 00002000:00010000:0.0:1788684254.072443:0:9991:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788684254.072521:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073178880:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 346us (577us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788684254.072550:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:2.0:1788684254.082620:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684254.082753:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073179136 00000100:00100000:0.0:1788684254.082765:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073179136 00000100:00100000:0.0:1788684254.082836:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 200 00000100:00100000:0.0:1788684254.082847:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:12367:x1875571073179136:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788684254.082934:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.082953:0:12443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d08 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.082965:0:12443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.083006:0:12443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d08 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.083021:0:12443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d08 expref: 20 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684254.083055:0:12443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12443:1875571085811968:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684254.083173:0:12443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684254.095959:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.095999:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073179264 00000100:00100000:1.0:1788684254.096010:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073179264 00010000:00010000:1.0:1788684254.096075:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d08 expref: 21 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684254.096141:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00100000:1.0:1788684254.096159:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6748348c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:2393:x1875571073179264:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684254.096176:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684254.096190:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d08 expref: 21 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.096206:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d08 expref: 21 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.096392:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:1.0:1788684254.096398:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.096410:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.096418:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.096442:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684254.096507:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6748348c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:2393:x1875571073179264:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 349us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684254.096515:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 88 00010000:00010000:3.0:1788684254.097974:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890e00/0x44bac02bd54ad003 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d08 expref: 20 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684254.097997:0:12443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12443:1875571085811968:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684254.098039:0:12443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.098051:0:12443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.098194:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.098313:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.098321:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.098328:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.098334:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684254.098338:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.098346:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.098386:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:3.0:1788684254.098389:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788684254.098394:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.098401:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad03b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684254.098491:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:12367:x1875571073179136:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 Request processed in 15645us (15883us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788684254.098500:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 200 00000100:00100000:3.0:1788684254.100181:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.100349:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073179392 00000100:00100000:2.0:1788684254.100362:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073179392 00000100:00100000:2.0:1788684254.100650:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:2.0:1788684254.100663:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2391:x1875571073179392:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788684254.100719:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.100746:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.100756:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684254.100773:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684254.100778:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.100824:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.100847:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 8 pid: 8412 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.100865:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8412:1875571085812096:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684254.100971:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788684254.107280:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8412:1875571085812096:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684254.107324:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.108939:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.108987:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073179520 00000100:00100000:2.0:1788684254.108997:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073179520 00010000:00010000:2.0:1788684254.109043:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 9 pid: 8412 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.109492:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:2.0:1788684254.109832:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2392:x1875571073179520:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684254.109858:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684254.109889:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 9 pid: 8412 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.109908:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 9 pid: 8412 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.109939:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad02d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d24 expref: 9 pid: 8412 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.109960:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684254.109986:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684254.109994:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.110005:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.110051:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684254.111183:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073179520:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 1672us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.111198:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 89 00010000:00010000:2.0:1788684254.111329:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.111341:0:8412:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.111395:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.111404:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.111485:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.111494:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684254.111507:0:8412:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.111517:0:8412:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.111612:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.111621:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad042 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.111695:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2391:x1875571073179392:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 11034us (11521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.111704:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:1.0:1788684254.121916:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.122016:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073179776 00000100:00100000:2.0:1788684254.122027:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073179776 00000100:00100000:2.0:1788684254.122181:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 201 00000100:00100000:2.0:1788684254.122194:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66459be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:12367:x1875571073179776:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788684254.122312:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.122334:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cad expref: 19 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.122346:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.122624:0:7963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cad expref: 19 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.122642:0:7963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cad expref: 19 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.122658:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085812224:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684254.122774:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684254.135238:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684254.135299:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073179904 00000100:00100000:0.0:1788684254.135310:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073179904 00010000:00010000:0.0:1788684254.135393:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cad expref: 20 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684254.135437:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 90 00000100:00100000:0.0:1788684254.135451:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:2393:x1875571073179904:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684254.135467:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684254.135476:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cad expref: 20 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.135491:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cad expref: 20 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.135518:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684254.135525:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.135538:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.135557:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.135593:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684254.135655:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:2393:x1875571073179904:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 208us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684254.135663:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 90 00010000:00010000:3.0:1788684254.137636:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ace90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cad expref: 19 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684254.137662:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085812224:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684254.137692:0:7963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.138124:0:7963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.138133:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.139052:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.139079:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d0f expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.139090:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.139142:0:7963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d0f expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.139163:0:7963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d0f expref: 19 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684254.139181:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085812352:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684254.139347:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67453980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684254.144597:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.144628:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085812352:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684254.144665:0:7963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.144702:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073180032 00000100:00100000:2.0:1788684254.144710:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073180032 00010000:00010000:2.0:1788684254.144750:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d0f expref: 20 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.145473:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 91 00000100:00100000:2.0:1788684254.145488:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:2392:x1875571073180032:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684254.145509:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684254.145520:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d0f expref: 20 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.145536:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d0f expref: 20 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.145589:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad011 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d0f expref: 20 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.145604:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:2.0:1788684254.145611:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.145622:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.145631:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.145666:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684254.145736:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:2392:x1875571073180032:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 251us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.145745:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 91 00010000:00010000:1.0:1788684254.146969:0:7963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.146986:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788684254.147189:0:7963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788684254.147340:0:7963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:1.0:1788684254.147420:0:7963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788684254.147564:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7963:1875571085812480:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788684254.147647:0:7963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684254.147694:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788684254.147938:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085812480 00000100:00100000:2.0:1788684254.147947:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085812480 00000100:00100000:2.0:1788684254.148140:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788684254.148262:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7963:x1875571085812480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788684254.148594:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7963:x1875571085812480:12345-0@lo:1000:mdt00_003.0 Request processed in 444us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.148603:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788684254.149510:0:7963:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788684254.149521:0:7963:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d66459bf100, transno 4294967316 00000100:00100000:1.0:1788684254.149552:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7963:1875571085812480:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788684254.149853:0:7963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:1.0:1788684254.149930:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7963:1875571085812608:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788684254.149994:0:7963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684254.150038:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788684254.150230:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085812608 00000100:00100000:2.0:1788684254.150239:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085812608 00000100:00100000:2.0:1788684254.150292:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788684254.150302:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7963:x1875571085812608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788684254.150494:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7963:x1875571085812608:12345-0@lo:1000:mdt00_003.0 Request processed in 193us (499us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788684254.150503:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788684254.150556:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7963:1875571085812608:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788684254.150601:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.150613:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.150622:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151517:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684254.151533:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151554:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151575:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:2.0:1788684254.151578:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684254.151583:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151591:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad050 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151622:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151645:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151652:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151658:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684254.151662:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151669:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151683:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684254.151686:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684254.151690:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151697:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54acf85 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151725:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151743:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cf3 expref: 22 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151754:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151793:0:7963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cf3 expref: 22 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.151920:0:7963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cf3 expref: 22 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.151935:0:7963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085812736:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684254.152282:0:7963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684254.160888:0:7963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7963:1875571085812736:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684254.160932:0:7963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.165813:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.170809:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073180160 00000100:00100000:1.0:1788684254.170829:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073180160 00010000:00010000:1.0:1788684254.170888:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cf3 expref: 23 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684254.170938:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 92 00000100:00100000:1.0:1788684254.170949:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:2390:x1875571073180160:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684254.170967:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684254.170976:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cf3 expref: 23 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.170991:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cf3 expref: 23 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.171032:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54acfa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3cf3 expref: 23 pid: 12443 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.171957:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684254.171967:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.171981:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.171989:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.175312:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684254.175468:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:2390:x1875571073180160:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 4511us (9661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684254.175483:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 92 00010000:00010000:1.0:1788684254.182697:0:7963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182720:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182739:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182747:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182756:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182763:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.182769:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182789:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182811:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684254.182815:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.182867:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182877:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad057 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182891:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182896:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182902:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182908:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.182910:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182916:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182925:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684254.182927:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788684254.182930:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.182946:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad049 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684254.183203:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66459be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12367:x1875571073179776:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 61005us (61291us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788684254.183215:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 201 00000020:00080000:1.0:1788684254.183232:0:7963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788684254.183385:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684254.183391:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684254.183918:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788684254.183928:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788684254.196758:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684254.196893:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073180416 00000100:00100000:0.0:1788684254.196907:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073180416 00000100:00100000:0.0:1788684254.196977:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:0.0:1788684254.196989:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749555050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12367:x1875571073180416:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788684254.199506:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788684254.199561:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:0.0:1788684254.199604:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199625:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199638:0:6500:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199648:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199655:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199661:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199689:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788684254.199815:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749555050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:12367:x1875571073180416:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 2822us (3067us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788684254.199827:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000020:00080000:0.0:1788684254.199835:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788684254.199917:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684254.199925:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199934:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684254.199939:0:6486:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199948:0:6486:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199964:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:0.0:1788684254.199968:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788684254.199974:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199981:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad05e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.199995:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684254.199998:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684254.200000:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788684254.254048:0:14684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684254.254061:0:14684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684254.254093:0:14684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788684254.254109:0:14684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684254.334876:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085812864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684254.334948:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684254.335020:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085812864 00000100:00100000:0.0:1788684254.335028:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085812864 00000100:00100000:0.0:1788684254.335071:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788684254.335079:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875571085812864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788684254.335106:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788684254.335148:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875571085812864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684254.335155:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788684254.335202:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085812864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684254.336611:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788684254.336627:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664842fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085812992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684254.336675:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684254.336732:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085812992 00000100:00100000:1.0:1788684254.336737:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085812992 00000100:00100000:1.0:1788684254.336795:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788684254.336804:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085812992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684254.336821:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788684254.336859:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085812992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684254.336866:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1788684254.336884:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684254.336912:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664842fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085812992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684254.339610:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085813248:0@lo:400:kworker.0 00000100:00100000:0.0:1788684254.339676:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684254.339952:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085813120:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.339989:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684254.340059:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085813376:0@lo:400:kworker.0 00000100:00100000:0.0:1788684254.340090:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684254.340146:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684254.340152:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085813760:0@lo:400:kworker.0 00000100:00100000:0.0:1788684254.340175:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684254.340214:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085813888:0@lo:400:kworker.0 00000100:00100000:0.0:1788684254.340237:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684254.340312:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684254.340320:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66487bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085814272:0@lo:400:kworker.0 00000100:00100000:0.0:1788684254.340345:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684254.340450:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085813376 00000100:00100000:2.0:1788684254.340457:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085813376 00000100:00100000:2.0:1788684254.340507:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788684254.340517:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085813376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.340582:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085813376:12345-0@lo:400:kworker.0 Request processed in 65us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.340589:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788684254.340618:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085813632:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.340642:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684254.340657:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66487bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085814144:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.340699:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684254.340720:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788684254.340726:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66485d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085813504:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.340749:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684254.341021:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66459bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085814016:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.341053:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684254.341097:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085813376:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.341579:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085813248 00000100:00100000:2.0:1788684254.341585:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085813248 00000100:00100000:2.0:1788684254.341617:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085813760 00000100:00100000:2.0:1788684254.341620:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085813760 00000100:00100000:2.0:1788684254.341641:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085813888 00000100:00100000:2.0:1788684254.341644:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085813888 00000100:00100000:2.0:1788684254.341655:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085814144 00000100:00100000:2.0:1788684254.341657:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085814144 00000100:00100000:2.0:1788684254.341668:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085813504 00000100:00100000:2.0:1788684254.341671:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085813504 00000100:00100000:2.0:1788684254.341679:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085814016 00000100:00100000:2.0:1788684254.341681:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085814016 00000100:00100000:2.0:1788684254.341713:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788684254.341719:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085813248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.341950:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085813248:12345-0@lo:400:kworker.0 Request processed in 229us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.341958:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788684254.341977:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788684254.341984:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66485d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085813760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.342018:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66485d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085813760:12345-0@lo:400:kworker.0 Request processed in 35us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.342024:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788684254.342035:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788684254.342041:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085813888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.342070:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085813888:12345-0@lo:400:kworker.0 Request processed in 30us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.342089:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788684254.342102:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788684254.342108:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085814144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.342143:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085814144:12345-0@lo:400:kworker.0 Request processed in 34us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.342149:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788684254.342161:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788684254.342166:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085813504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.342193:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085813504:12345-0@lo:400:kworker.0 Request processed in 27us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.342198:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788684254.342210:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788684254.342216:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085814016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.342242:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085814016:12345-0@lo:400:kworker.0 Request processed in 27us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.342247:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788684254.342268:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085813120 00000100:00100000:2.0:1788684254.342272:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085813120 00000100:00100000:2.0:1788684254.342295:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788684254.342302:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085813120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.342330:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085813120:12345-0@lo:400:kworker.0 Request processed in 29us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.342335:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788684254.342577:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085813632 00000100:00100000:0.0:1788684254.342589:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085813632 00000100:00100000:0.0:1788684254.342619:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788684254.342625:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085813632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684254.342663:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085813632:12345-0@lo:400:kworker.0 Request processed in 38us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684254.342668:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788684254.342908:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085813248:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.342957:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085813504:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.342970:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66459bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085814016:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.342981:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085813632:0@lo:400:kworker.0 00010000:00080000:2.0:1788684254.342992:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66487bdc00 x1875571085814144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684254.343002:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66487bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085814144:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.343012:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085813120:0@lo:400:kworker.0 00010000:00080000:2.0:1788684254.343045:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66485d0a80 x1875571085813888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684254.343055:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085813888:0@lo:400:kworker.0 00000100:00100000:2.0:1788684254.343065:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66485d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085813760:0@lo:400:kworker.0 00000100:00100000:3.0:1788684254.343156:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085814272 00000100:00100000:3.0:1788684254.343161:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085814272 00000100:00100000:3.0:1788684254.343202:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788684254.343209:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085814272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684254.343257:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085814272:12345-0@lo:400:kworker.0 Request processed in 48us (2911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684254.343264:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788684254.343930:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66487bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085814272:0@lo:400:kworker.0 00000100:00080000:1.0:1788684254.344123:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788684254.344129:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684254.344131:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684254.401320:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.403279:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073180672 00000100:00100000:2.0:1788684254.403300:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073180672 00000100:00100000:2.0:1788684254.403422:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 202 00000100:00100000:2.0:1788684254.403435:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664842fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:12377:x1875571073180672:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684254.403462:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684254.403483:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad065 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d2b expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.403607:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ad06c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.403621:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ad06c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.403658:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ad06c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684254.403673:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788684254.403789:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad065 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d2b expref: 26 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.403808:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ad06c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d2b expref: 25 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.403817:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684254.403820:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788684254.403824:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4200, rc 0) 00000100:00100000:2.0:1788684254.403892:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664842fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:12377:x1875571073180672:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 459us (2582us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788684254.403899:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 202 00000100:00100000:2.0:1788684254.405832:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.405904:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073180800 00000100:00100000:1.0:1788684254.405913:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073180800 00000100:00100000:1.0:1788684254.405965:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 203 00000100:00100000:1.0:1788684254.405982:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:12377:x1875571073180800:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:1.0:1788684254.406049:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406064:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406075:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406090:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406097:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406104:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406175:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406184:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406190:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684254.406232:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406244:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406257:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406263:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406269:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.406273:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406290:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406302:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:1.0:1788684254.406305:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.406309:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406315:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad07a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406325:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406331:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406337:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406342:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.406350:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406356:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406386:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6641867300) 00010000:00010000:1.0:1788684254.406389:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.406392:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406399:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad081 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406413:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406419:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406424:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406429:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.406432:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406438:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406446:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867e00) 00010000:00010000:1.0:1788684254.406448:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.406456:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.406462:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad088 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684254.406526:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:12377:x1875571073180800:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 545us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684254.406534:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 203 00000100:00100000:3.0:1788684254.472761:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.472860:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073181056 00000100:00100000:1.0:1788684254.472869:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073181056 00000100:00100000:1.0:1788684254.472932:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 204 00000100:00100000:1.0:1788684254.472942:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:12380:x1875571073181056:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684254.472961:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684254.472981:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad08f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d32 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473047:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473061:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473071:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473086:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473093:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473116:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473215:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473224:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473231:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684254.473240:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788684254.473311:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473319:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473325:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473331:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.473335:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473343:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473354:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:1.0:1788684254.473357:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.473408:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473415:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad096 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473427:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473433:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473439:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473444:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.473447:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473452:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473460:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6641867e00) 00010000:00010000:1.0:1788684254.473462:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.473465:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473471:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad09d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473507:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ad08f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d32 expref: 28 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473534:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d32 expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.473551:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684254.473553:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788684254.473556:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1400, rc 0) 00000100:00100000:1.0:1788684254.473607:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:12380:x1875571073181056:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 666us (854us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788684254.473615:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 204 00000100:00100000:1.0:1788684254.489469:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684254.489653:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073181184 00000100:00100000:3.0:1788684254.489876:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073181184 00000100:00100000:3.0:1788684254.489954:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 205 00000100:00100000:3.0:1788684254.489965:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:12380:x1875571073181184:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:3.0:1788684254.490057:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.490077:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.490091:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.490134:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.490141:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.490149:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.490155:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684254.490160:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.490168:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.490181:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684254.490184:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684254.490189:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.490206:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad0b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684254.490302:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:12380:x1875571073181184:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 338us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684254.490310:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 205 00000100:00100000:0.0:1788684254.501408:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684254.502798:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073181440 00000100:00100000:3.0:1788684254.502817:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073181440 00000100:00100000:2.0:1788684254.503074:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:2.0:1788684254.503089:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:12380:x1875571073181440:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684254.503412:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+28:12380:x1875571073181440:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 326us (2018us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788684254.503421:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:2.0:1788684254.544852:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.544984:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073181696 00000100:00100000:1.0:1788684254.544997:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073181696 00000100:00100000:1.0:1788684254.545073:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 206 00000100:00100000:1.0:1788684254.545085:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+28:11912:x1875571073181696:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1788684254.545297:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684254.545325:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad0b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d39 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.545610:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.545736:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d32 expref: 29 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.545748:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.545863:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d32 expref: 29 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.545880:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d32 expref: 29 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684254.545896:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085814400:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684254.546292:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684254.549903:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67772fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085814400:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684254.549950:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.550280:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684254.550552:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073181824 00000100:00100000:3.0:1788684254.550561:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073181824 00010000:00010000:3.0:1788684254.550733:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d32 expref: 30 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684254.550947:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 93 00000100:00100000:3.0:1788684254.550958:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:2392:x1875571073181824:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684254.550976:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684254.550983:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d32 expref: 30 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.550998:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d32 expref: 30 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.551023:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad0a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d32 expref: 30 pid: 6498 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.551043:0:9510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684254.551047:0:9510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.551475:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.551484:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.551520:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684254.551554:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.551562:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684254.551585:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00000100:00100000:3.0:1788684254.551717:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:2392:x1875571073181824:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 759us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684254.551726:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 93 00010000:00010000:2.0:1788684254.551817:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad0b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d39 expref: 31 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.551838:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d39 expref: 30 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.551846:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684254.551849:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788684254.551851:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1a00, rc 0) 00000100:00100000:2.0:1788684254.551881:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:11912:x1875571073181696:12345-192.168.206.44@tcp:101:bash.0 Request processed in 6799us (7045us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788684254.551889:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 206 00000100:00100000:1.0:1788684254.555040:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.555232:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073181952 00000100:00100000:2.0:1788684254.555245:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073181952 00000100:00100000:2.0:1788684254.555347:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 207 00000100:00100000:2.0:1788684254.555360:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:11912:x1875571073181952:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684254.555429:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684254.555464:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad0ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d40 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.555537:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad0d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.555567:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.555578:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.555717:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad0ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d40 expref: 31 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.555738:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad0d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d40 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.555748:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684254.555751:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788684254.555765:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5000, rc 0) 00000100:00100000:2.0:1788684254.555833:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:11912:x1875571073181952:12345-192.168.206.44@tcp:101:bash.0 Request processed in 476us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.555842:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 207 00000100:00100000:0.0:1788684254.560531:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.561252:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073182208 00000100:00100000:2.0:1788684254.561266:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073182208 00000100:00100000:2.0:1788684254.561345:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 208 00000100:00100000:2.0:1788684254.561357:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:11912:x1875571073182208:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:2.0:1788684254.561931:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.561974:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.561987:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684254.562041:0:13784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:2.0:1788684254.562068:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afc33a37 reply state 00000000cb432ab7 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.562084:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.562092:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684254.562095:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684254.562100:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788684254.562146:0:13784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:2.0:1788684254.562360:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+34:11912:x1875571073182208:12345-192.168.206.44@tcp:36:bash.0 Request processed in 1002us (1840us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788684254.562531:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 208 00000020:00080000:2.0:1788684254.562537:0:13784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788684254.565195:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.565839:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073182336 00000100:00100000:2.0:1788684254.565853:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073182336 00000100:00100000:2.0:1788684254.566016:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 209 00000100:00100000:2.0:1788684254.566030:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+34:11912:x1875571073182336:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684254.566061:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684254.566086:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad0e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d47 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.566187:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad0e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d47 expref: 35 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.566204:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad0e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d47 expref: 35 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.566229:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684254.566233:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684254.566237:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684254.566316:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:11912:x1875571073182336:12345-192.168.206.44@tcp:101:bash.0 Request processed in 290us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.566324:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 209 00000100:00100000:3.0:1788684254.568885:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684254.569043:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073182464 00000100:00100000:0.0:1788684254.569056:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073182464 00000100:00100000:0.0:1788684254.569126:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:0.0:1788684254.569137:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:11912:x1875571073182464:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1788684254.569159:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684254.569185:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d4e expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684254.569217:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9d27dd, atime: 0x6a9d27db, ctime: 0x6a9d27dd, blocks: 0x8 00010000:00010000:0.0:1788684254.569243:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1788684254.569248:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684254.569258:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d4e expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.569276:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d4e expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.569290:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890000, rc 0) 00000100:00100000:0.0:1788684254.569349:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:11912:x1875571073182464:12345-192.168.206.44@tcp:101:bash.0 Request processed in 214us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684254.569423:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:0.0:1788684254.572323:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.572461:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073182592 00000100:00100000:1.0:1788684254.572691:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073182592 00002000:00010000:1.0:1788684254.572747:0:8418:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788684254.572753:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d66487bf100 with x1875571073182592 ext(0->18446744073709551615) 00002000:00010000:1.0:1788684254.573828:0:8418:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d66487bf100. 00000100:00100000:1.0:1788684254.573884:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:1.0:1788684254.573903:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2393:x1875571073182592:12345-192.168.206.44@tcp:10:bash.0 00002000:00010000:1.0:1788684254.574247:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788684254.574252:0:8418:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788684253 -> 1788684254 00002000:00010000:1.0:1788684254.574255:0:8418:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788684251 -> 1788684251 00002000:00010000:1.0:1788684254.574257:0:8418:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788684253 -> 1788684254 00002000:00010000:1.0:1788684254.574260:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788684254.574338:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2393:x1875571073182592:12345-192.168.206.44@tcp:10:bash.0 Request processed in 443us (2026us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788684254.574346:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00002000:00010000:1.0:1788684254.574351:0:8418:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788684254.574387:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d66487bf100 with x1875571073182592 ext(0->18446744073709551615) 00002000:00010000:1.0:1788684254.574395:0:8418:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d66487bf100. 00000100:00100000:3.0:1788684254.641719:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.641910:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073182720 00000100:00100000:1.0:1788684254.641924:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073182720 00000100:00100000:1.0:1788684254.642004:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 210 00000100:00100000:1.0:1788684254.642018:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:12394:x1875571073182720:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:1.0:1788684254.642123:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642143:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642157:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642176:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642183:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642189:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642288:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642299:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642306:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684254.642448:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642463:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642471:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642479:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642485:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.642490:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642498:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642515:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:1.0:1788684254.642518:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.642523:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642529:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad0f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642554:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642560:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642572:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642577:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.642580:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642587:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642596:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6641867e00) 00010000:00010000:1.0:1788684254.642598:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.642602:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642607:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad0f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642623:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642630:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642636:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642641:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.642643:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642660:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642668:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684254.642671:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.642674:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.642679:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad0ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684254.642779:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:12394:x1875571073182720:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 763us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684254.642789:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 210 00000100:00100000:0.0:1788684254.685086:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684254.685206:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073182976 00000100:00100000:3.0:1788684254.685219:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073182976 00000100:00100000:3.0:1788684254.685303:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 211 00000100:00100000:3.0:1788684254.685315:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+35:12397:x1875571073182976:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684254.685341:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684254.685415:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad106 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d55 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685516:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685533:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685559:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685597:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685605:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685612:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685756:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ad11b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685766:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ad11b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685774:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ad11b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684254.685785:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788684254.685886:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685894:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685901:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685908:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684254.685913:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685932:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685946:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:3.0:1788684254.685949:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684254.685955:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685962:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad10d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685978:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685983:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685989:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.685995:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711ca00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684254.685998:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.686004:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.686010:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684254.686013:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684254.686015:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.686030:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad114 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.686080:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad106 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d55 expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.686093:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ad11b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d55 expref: 37 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.686100:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684254.686102:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788684254.686105:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d600, rc 0) 00000100:00100000:3.0:1788684254.687184:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:12397:x1875571073182976:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1861us (2102us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788684254.687197:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 211 00000100:00100000:0.0:1788684254.691204:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.691677:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073183104 00000100:00100000:1.0:1788684254.691690:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073183104 00000100:00100000:1.0:1788684254.691872:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 212 00000100:00100000:1.0:1788684254.691885:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:12397:x1875571073183104:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:1.0:1788684254.691976:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.691997:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d39 expref: 37 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.692009:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.692056:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d39 expref: 37 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.692094:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d39 expref: 37 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684254.692181:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085814528:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684254.692629:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684254.696466:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6499:1875571085814528:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684254.696510:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684254.697444:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.697724:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073183360 00000100:00100000:2.0:1788684254.697735:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073183360 00000100:00100000:2.0:1788684254.697803:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:2.0:1788684254.697814:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:6158:x1875571073183360:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788684254.698232:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:6158:x1875571073183360:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 418us (793us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788684254.698241:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:0.0:1788684254.701421:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.701568:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073183488 00000100:00100000:2.0:1788684254.701581:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073183488 00010000:00010000:2.0:1788684254.701630:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d39 expref: 39 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.701679:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 94 00000100:00100000:2.0:1788684254.701691:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:2392:x1875571073183488:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684254.701729:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684254.701738:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d39 expref: 39 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.701754:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d39 expref: 39 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.701850:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad0c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d39 expref: 39 pid: 6499 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.701870:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684254.701876:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.701886:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.701894:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.701920:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684254.702065:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.702074:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.702155:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.702164:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.702171:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.702177:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.702181:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.702189:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.702210:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684254.702213:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684254.702218:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.702225:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684254.702302:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:2392:x1875571073183488:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 611us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.702312:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 94 00000100:00100000:1.0:1788684254.703431:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:12397:x1875571073183104:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 11539us (12231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684254.703444:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 212 00000100:00100000:3.0:1788684254.706216:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.706297:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073183744 00000100:00100000:2.0:1788684254.706310:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073183744 00000100:00100000:2.0:1788684254.706419:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:2.0:1788684254.706431:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+37:12397:x1875571073183744:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684254.707433:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:12397:x1875571073183744:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 998us (1223us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788684254.707445:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:3.0:1788684254.792579:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.792701:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073184000 00000100:00100000:1.0:1788684254.792716:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073184000 00000100:00100000:1.0:1788684254.792801:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 213 00000100:00100000:1.0:1788684254.792813:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+38:12408:x1875571073184000:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:1.0:1788684254.792845:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684254.792873:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad130 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d5c expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.792975:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.792996:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793009:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793027:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793047:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793054:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793196:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad145 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793207:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad145 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793215:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad145 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684254.793226:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788684254.793322:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793330:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793338:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793344:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.793350:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793358:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793422:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:1.0:1788684254.793425:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.793432:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793440:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad137 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793458:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793464:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793469:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793474:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684254.793476:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793482:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793488:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6641867e00) 00010000:00010000:1.0:1788684254.793491:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684254.793493:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793499:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad13e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793571:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad130 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d5c expref: 41 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793586:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad145 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d5c expref: 40 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.793593:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684254.793595:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788684254.793597:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1a00, rc 0) 00000100:00100000:1.0:1788684254.793682:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+40:12408:x1875571073184000:12345-192.168.206.44@tcp:101:cat.0 Request processed in 871us (1117us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788684254.793691:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 213 00000100:00100000:0.0:1788684254.803460:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.803607:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073184256 00000100:00100000:1.0:1788684254.803622:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073184256 00000100:00100000:1.0:1788684254.803695:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:1.0:1788684254.803707:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+40:12408:x1875571073184256:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:1.0:1788684254.804087:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+41:12408:x1875571073184256:12345-192.168.206.44@tcp:35:cat.0 Request processed in 380us (640us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788684254.804097:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:0.0:1788684254.823704:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.823823:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073184512 00000100:00100000:2.0:1788684254.823837:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073184512 00000100:00100000:2.0:1788684254.823909:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 214 00000100:00100000:2.0:1788684254.823921:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+41:12409:x1875571073184512:12345-192.168.206.44@tcp:36:rm.0 00010000:00010000:2.0:1788684254.823995:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788684254.824033:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad0e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d47 expref: 41 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824063:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad145 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d5c expref: 40 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824079:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d600/0x44bac02bd54ad11b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d55 expref: 39 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824093:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad0d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d40 expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824104:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684254.824109:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684254.824138:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824154:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824189:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824207:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824215:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824222:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824331:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824340:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824348:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788684254.824716:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:2.0:1788684254.824780:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824791:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824799:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824808:0:13784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824824:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824830:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824861:0:13784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684254.824887:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824893:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824899:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824905:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684254.824910:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824919:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824930:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684254.824934:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788684254.824938:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824945:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad161 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824967:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824980:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824987:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.824993:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684254.824996:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.825003:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.825012:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684254.825014:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684254.825018:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.825024:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad153 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684254.825036:0:13784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fe7d187 reply state 000000001a620517 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.825048:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.825055:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580100) 00010000:00010000:2.0:1788684254.825057:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684254.825060:0:13784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684254.825162:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:12409:x1875571073184512:12345-192.168.206.44@tcp:36:rm.0 Request processed in 1240us (1470us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788684254.825178:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 214 00010000:00010000:0.0:1788684254.825412:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684254.825421:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.825429:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684254.825433:0:9499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.825440:0:9499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.825450:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684254.825453:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788684254.825456:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.825462:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad168 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.825474:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684254.825476:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684254.825478:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684254.846189:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684254.846339:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684254.846388:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085814784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684254.846488:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684254.846591:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085814784 00000100:00100000:2.0:1788684254.846601:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085814784 00000100:00100000:2.0:1788684254.846657:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788684254.846667:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085814784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684254.846708:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788684254.846773:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085814784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.846780:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788684254.846833:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085814784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684254.847025:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684254.847038:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085814656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684254.847075:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684254.848915:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085814912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684254.848990:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684254.849518:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085814656 00000100:00100000:2.0:1788684254.849530:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085814656 00000100:00100000:2.0:1788684254.849600:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085814912 00000100:00100000:2.0:1788684254.849604:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085814912 00000100:00100000:2.0:1788684254.849623:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788684254.849633:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085814656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684254.849659:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788684254.849733:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085814656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (2656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684254.849741:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788684254.849851:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788684254.849861:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085814912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684254.849873:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1788684254.849910:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085814912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684254.849917:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788684254.849969:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085814912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684254.850169:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085814656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684254.874994:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.875137:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073184768 00000100:00100000:2.0:1788684254.875151:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073184768 00000100:00100000:2.0:1788684254.875231:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 215 00000100:00100000:2.0:1788684254.875264:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+39:12415:x1875571073184768:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684254.875297:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684254.875326:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad16f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d63 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.875716:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.875735:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.875748:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.875762:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.875769:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.875777:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788684254.876496:0:12443:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788684254.876696:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.876710:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.876720:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.876922:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.876931:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.876939:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.876946:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684254.876951:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.876961:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.876977:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684254.876980:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684254.876986:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.876993:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad176 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684254.877011:0:12443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000997b5a34 reply state 00000000f369c3c7 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.877024:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.877031:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580100) 00010000:00010000:2.0:1788684254.877041:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684254.877045:0:12443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788684254.877086:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad16f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d63 expref: 42 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.877613:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d63 expref: 41 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684254.877624:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580a00) 00010000:00010000:2.0:1788684254.877626:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684254.877629:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684254.877723:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+42:12415:x1875571073184768:12345-192.168.206.44@tcp:101:bash.0 Request processed in 2462us (2743us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788684254.877733:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 215 00000100:00100000:0.0:1788684254.881082:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684254.881352:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073184896 00000100:00100000:3.0:1788684254.881410:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073184896 00000100:00100000:3.0:1788684254.881501:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:3.0:1788684254.881514:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2391:x1875571073184896:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684254.881549:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684254.881578:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d6a expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788684254.881632:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684254.881661:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1788684254.881666:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684254.881678:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d6a expref: 8 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.881702:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d6a expref: 8 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.881719:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c000, rc 0) 00000100:00100000:3.0:1788684254.881804:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2391:x1875571073184896:12345-192.168.206.44@tcp:101:bash.0 Request processed in 292us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684254.881812:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00080000:0.0:1788684254.882748:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684254.885051:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684254.885148:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073185024 00000100:00100000:3.0:1788684254.885161:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073185024 00000100:00100000:3.0:1788684254.885270:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:3.0:1788684254.885282:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:12415:x1875571073185024:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684254.885307:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684254.885331:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d71 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.885413:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d6a expref: 9 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.885450:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684254.885455:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684254.885463:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.885508:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d6a expref: 9 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684254.885524:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d6a expref: 9 pid: 8411 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684254.885553:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875571085815040:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684254.885664:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684254.888019:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875571085815040:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684254.888064:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684254.888089:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711ca00, rc 0) 00000100:00100000:0.0:1788684254.888177:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:12415:x1875571073185024:12345-192.168.206.44@tcp:101:bash.0 Request processed in 2896us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684254.888186:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:1.0:1788684254.889698:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.889734:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073185152 00000100:00100000:1.0:1788684254.889744:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073185152 00010000:00010000:1.0:1788684254.889817:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d6a expref: 9 pid: 8411 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684254.889856:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 95 00000100:00100000:1.0:1788684254.889866:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2392:x1875571073185152:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684254.889882:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684254.889908:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d6a expref: 9 pid: 8411 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.889922:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d6a expref: 9 pid: 8411 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.889949:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac76ca68/0x44bac02bd54ad192 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d6a expref: 9 pid: 8411 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.889969:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684254.889974:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684254.889984:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.889995:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684254.890047:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684254.890079:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6482:1875571085815168:192.168.206.44@tcp:105: 00000100:00100000:1.0:1788684254.890168:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684254.894132:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.894180:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073185408 00000100:00100000:1.0:1788684254.894191:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073185408 00000100:00100000:1.0:1788684254.894261:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:1.0:1788684254.894272:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+42:12415:x1875571073185408:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:1.0:1788684254.894680:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:12415:x1875571073185408:12345-192.168.206.44@tcp:35:bash.0 Request processed in 408us (561us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788684254.894689:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:3.0:1788684254.895015:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6482:1875571085815168:192.168.206.44@tcp:105: 00010000:00010000:3.0:1788684254.895045:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684254.895079:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073185152:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 5215us (5391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684254.895090:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 95 00000100:00100000:1.0:1788684254.905433:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684254.905485:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684254.905646:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073185536 00000100:00100000:2.0:1788684254.905659:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073185536 00002000:00100000:2.0:1788684254.905724:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d664856ed80 x1875571073185536/t0(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:175/0 lens 504/0 e 0 to 0 dl 1788684265 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788684254.905736:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d664856ed80 with x1875571073185536 ext(0->8) 00002000:00010000:2.0:1788684254.905744:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d664856ed80 00000100:00100000:2.0:1788684254.905790:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:2.0:1788684254.905802:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2390:x1875571073185536:12345-192.168.206.44@tcp:4:bash.0 00000100:00100000:0.0:1788684254.907572:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073185664 00000100:00100000:0.0:1788684254.907588:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073185664 00000100:00100000:0.0:1788684254.907660:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:0.0:1788684254.907672:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:2390:x1875571073185664:12345-192.168.206.44@tcp:16:kworker.0 00000100:00100000:1.0:1788684254.908669:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:2390:x1875571073185536:12345-192.168.206.44@tcp:4:bash.0 Request processed in 2861us (3175us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788684254.908682:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00002000:00100000:1.0:1788684254.908696:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8d664856ed80 x1875571073185536/t4294967309(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:175/0 lens 504/448 e 0 to 0 dl 1788684265 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788684254.908708:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d664856ed80 with x1875571073185536 ext(0->8) 00002000:00010000:1.0:1788684254.908715:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d664856ed80 00000001:00080000:3.0:1788684254.910968:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788684254.910992:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788684254.911218:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2390:x1875571073185664:12345-192.168.206.44@tcp:16:kworker.0 Request processed in 3542us (5791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684254.911246:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:1.0:1788684255.078020:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.079967:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073185792 00000100:00100000:2.0:1788684255.079988:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073185792 00000100:00100000:2.0:1788684255.080120:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 216 00000100:00100000:2.0:1788684255.080135:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+43:12431:x1875571073185792:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684255.080166:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684255.080212:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d78 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.080292:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad1a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.080308:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.080324:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684255.080414:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788684255.080420:0:7963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684255.080445:0:7963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.080475:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d78 expref: 45 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.080497:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d78 expref: 44 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.080506:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684255.080509:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684255.080513:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4c00, rc 0) 00000100:00100000:2.0:1788684255.080614:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:12431:x1875571073185792:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 482us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.080622:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 216 00000100:00080000:0.0:1788684255.080755:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684255.087565:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.087663:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073186048 00000100:00100000:2.0:1788684255.087695:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073186048 00000100:00100000:2.0:1788684255.087774:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 217 00000100:00100000:2.0:1788684255.087787:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+44:12431:x1875571073186048:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684255.087815:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684255.087842:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d7f expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.088004:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad1b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.088021:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.088034:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684255.088048:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788684255.088187:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d7f expref: 47 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.088211:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d7f expref: 46 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.088222:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580a00) 00010000:00010000:2.0:1788684255.088226:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684255.088231:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4600, rc 0) 00000100:00100000:2.0:1788684255.088316:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+46:12431:x1875571073186048:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 532us (765us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788684255.088325:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 217 00000100:00100000:3.0:1788684255.093283:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684255.093418:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073186304 00000100:00100000:1.0:1788684255.093432:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073186304 00000100:00100000:1.0:1788684255.093516:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 218 00000100:00100000:1.0:1788684255.093528:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+46:12431:x1875571073186304:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684255.093587:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684255.093615:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ad1c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d86 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.093745:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad1ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.093774:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad1ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.093788:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad1ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684255.093802:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788684255.093927:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ad1c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d86 expref: 49 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.093950:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad1ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d86 expref: 48 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.093960:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580a00) 00010000:00010000:1.0:1788684255.093963:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788684255.093967:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1400, rc 0) 00000100:00100000:1.0:1788684255.094045:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+48:12431:x1875571073186304:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 519us (777us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1788684255.094053:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 218 00000100:00100000:1.0:1788684255.105615:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.105723:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073186432 00000100:00100000:2.0:1788684255.105736:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073186432 00000100:00100000:2.0:1788684255.105888:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:2.0:1788684255.105900:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+48:2392:x1875571073186432:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684255.105920:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684255.105962:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad1b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d7f expref: 48 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.105986:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580a00) 00010000:00010000:2.0:1788684255.105992:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684255.106065:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+47:2392:x1875571073186432:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 167us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.106073:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1788684255.111661:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.113106:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073186560 00000100:00100000:2.0:1788684255.113174:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073186560 00000100:00100000:3.0:1788684255.113353:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:3.0:1788684255.113644:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+6:2393:x1875571073186560:12345-192.168.206.44@tcp:1:lfs.0 00010000:00010000:3.0:1788684255.113723:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.113748:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.113827:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788684255.113832:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788684255.113838:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.113886:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.113902:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 6 pid: 8413 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684255.113919:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1875571085815296:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684255.114222:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684255.118222:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684255.118669:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073186688 00000100:00100000:1.0:1788684255.118682:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073186688 00010000:00010000:1.0:1788684255.118766:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 7 pid: 8413 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684255.118825:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 96 00000100:00100000:1.0:1788684255.118837:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073186688:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684255.118855:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788684255.118878:0:9510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788684255.118881:0:9510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788684254 00002000:00010000:1.0:1788684255.118883:0:9510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788684254 00002000:00010000:1.0:1788684255.118886:0:9510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788684255.118892:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 7 pid: 8413 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.118906:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 7 pid: 8413 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.118940:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788684255.118955:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788684255.118963:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.118974:0:9510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.118999:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684255.119067:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073186688:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 232us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684255.119085:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 96 00010000:00010000:3.0:1788684255.120351:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac8c31f8/0x44bac02bd54ad199 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d71 expref: 6 pid: 8413 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684255.120902:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1875571085815296:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684255.120935:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.121040:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.121048:0:8412:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.121081:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.121091:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.121100:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.121107:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684255.121262:0:8412:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.121274:0:8412:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.121296:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.121316:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3ad0e2/0x44bac02bd54ad1d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684255.121915:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2393:x1875571073186560:12345-192.168.206.44@tcp:1:lfs.0 Request processed in 8548us (10263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684255.121929:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:0.0:1788684255.125266:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684255.125646:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073186944 00000100:00100000:1.0:1788684255.125659:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073186944 00000100:00100000:1.0:1788684255.125729:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:1.0:1788684255.125740:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749556050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+47:12431:x1875571073186944:12345-192.168.206.44@tcp:35:lfs.0 00000004:00010000:1.0:1788684255.125836:0:6500:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad1ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d86 expref: 47 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788684255.126442:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788684255.126695:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1788684255.127313:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:1.0:1788684255.127389:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.127596:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d63 expref: 51 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.127608:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.128001:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d63 expref: 51 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.128022:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d63 expref: 51 pid: 12443 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684255.128040:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1875571085815424:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684255.128319:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684255.132249:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.132386:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6500:1875571085815424:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684255.132415:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073187072 00010000:00010000:2.0:1788684255.132423:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684255.132424:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073187072 00010000:00010000:0.0:1788684255.132632:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d63 expref: 52 pid: 12443 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684255.132678:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:0.0:1788684255.132690:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+52:2392:x1875571073187072:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684255.132710:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684255.132718:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d63 expref: 52 pid: 12443 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.132731:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d63 expref: 52 pid: 12443 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.132756:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad184 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d63 expref: 52 pid: 12443 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.132788:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580a00) 00010000:00010000:0.0:1788684255.132793:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.132804:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.132829:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.132861:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684255.132935:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+51:2392:x1875571073187072:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 246us (700us total) trans 0 rc 0/0 00010000:00010000:2.0:1788684255.132948:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.132956:0:6500:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684255.133116:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788684255.133160:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 97 00000001:00080000:2.0:1788684255.133650:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788684255.133774:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875571085815552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788684255.133852:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684255.135435:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788684255.135628:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085815552 00000100:00100000:3.0:1788684255.135639:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085815552 00000100:00100000:3.0:1788684255.135727:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788684255.135739:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6500:x1875571085815552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788684255.135763:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684255.136251:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6500:x1875571085815552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 512us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684255.136260:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788684255.142851:0:6500:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1788684255.142880:0:6500:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1788684255.142914:0:6500:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d6648557800, transno 4294967308 00000100:00100000:1.0:1788684255.142945:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875571085815552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788684255.143178:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1788684255.143638:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875571085815680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788684255.143728:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684255.143777:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684255.144208:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085815680 00000100:00100000:0.0:1788684255.144229:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085815680 00000100:00100000:0.0:1788684255.144307:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788684255.144319:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6500:x1875571085815680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788684255.144815:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6500:x1875571085815680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 497us (1085us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788684255.144825:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788684255.144935:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6500:1875571085815680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788684255.145007:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788684255.145072:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.145084:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.145092:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.145100:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684255.145105:0:6500:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.145115:0:6500:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.145135:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580a00) 00010000:00010000:1.0:1788684255.145138:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788684255.145164:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.145171:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ad1df lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788684255.145762:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788684255.145834:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788684255.145849:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336139482623ns, next at 337139479943ns, rc = 0 00000001:00080000:1.0:1788684255.145858:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1788684255.145907:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580a00) 00010000:00010000:1.0:1788684255.145911:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788684255.145920:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ad1ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d86 expref: 55 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684255.146681:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749556050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:12431:x1875571073186944:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 20937us (21422us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788684255.146695:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000020:00080000:1.0:1788684255.146702:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788684255.155041:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.155116:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073187200 00000100:00100000:2.0:1788684255.155128:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073187200 00000100:00100000:2.0:1788684255.155193:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 219 00000100:00100000:2.0:1788684255.155203:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+54:12431:x1875571073187200:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684255.155239:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684255.155266:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad1e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d8d expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.155345:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d8d expref: 55 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.155362:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d8d expref: 55 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.155438:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.155441:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684255.155445:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4600, rc 0) 00000100:00100000:2.0:1788684255.155523:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+55:12431:x1875571073187200:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 321us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.155532:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 219 00000100:00100000:0.0:1788684255.162861:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684255.163108:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073187456 00000100:00100000:3.0:1788684255.163123:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073187456 00000100:00100000:3.0:1788684255.163193:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1788684255.163206:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+55:12431:x1875571073187456:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684255.164772:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+56:12431:x1875571073187456:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 1556us (1914us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788684255.164787:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1788684255.257778:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.259007:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073187584 00000100:00100000:2.0:1788684255.259025:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073187584 00000100:00100000:2.0:1788684255.259243:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 220 00000100:00100000:2.0:1788684255.259257:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+56:12441:x1875571073187584:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:2.0:1788684255.259385:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259408:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259422:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259437:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259445:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259452:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259571:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259580:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259587:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684255.259919:0:13784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259936:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259958:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259966:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259971:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684255.259976:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.259984:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260001:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684255.260004:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684255.260009:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260016:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad1ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260033:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260039:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260045:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260051:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684255.260060:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260066:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260074:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580100) 00010000:00010000:2.0:1788684255.260077:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684255.260080:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260087:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad1f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260098:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260104:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260109:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260552:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684255.260557:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260564:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260575:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.260578:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684255.260590:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.260596:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad1fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684255.260791:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+56:12441:x1875571073187584:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 1534us (3023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.260802:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 220 00000100:00100000:1.0:1788684255.308691:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.308828:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073187840 00000100:00100000:2.0:1788684255.308841:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073187840 00000100:00100000:2.0:1788684255.308985:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 221 00000100:00100000:2.0:1788684255.308997:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+56:12444:x1875571073187840:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684255.309021:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684255.309348:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad202 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d94 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.309496:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.309515:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.309529:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.309550:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.309558:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.309588:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.309738:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad217 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.309748:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.309755:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684255.309772:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788684255.312231:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312256:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312264:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312271:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684255.312276:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312286:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312307:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684255.312312:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684255.312345:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312353:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad209 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312391:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312399:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312405:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312411:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684255.312414:0:6499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312419:0:6499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312427:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580100) 00010000:00010000:2.0:1788684255.312429:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684255.312433:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312438:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad210 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312504:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad202 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d94 expref: 59 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312548:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d94 expref: 58 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.312556:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.312559:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684255.312562:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5a00, rc 0) 00000100:00100000:2.0:1788684255.312668:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:12444:x1875571073187840:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 3672us (3990us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788684255.312678:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 221 00000100:00100000:0.0:1788684255.321147:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.321241:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073187968 00000100:00100000:2.0:1788684255.321254:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073187968 00000100:00100000:2.0:1788684255.321331:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 222 00000100:00100000:2.0:1788684255.321343:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:12444:x1875571073187968:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:2.0:1788684255.321480:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.321501:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.321515:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.321571:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.321579:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.321610:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.321616:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684255.321621:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.321631:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.321645:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.321649:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788684255.321654:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.321662:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad225 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684255.321747:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:12444:x1875571073187968:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 406us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.321756:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 222 00000100:00100000:0.0:1788684255.326922:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684255.327086:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073188224 00000100:00100000:1.0:1788684255.327099:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073188224 00000100:00100000:1.0:1788684255.327195:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:1.0:1788684255.327206:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+58:12444:x1875571073188224:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684255.327533:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:12444:x1875571073188224:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 327us (679us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788684255.327552:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:3.0:1788684255.358273:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085815808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684255.358686:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684255.358850:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085815808 00000100:00100000:1.0:1788684255.358886:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085815808 00000100:00100000:1.0:1788684255.358953:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788684255.358962:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085815808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684255.359005:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788684255.359077:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085815808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684255.359084:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788684255.359352:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085815808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684255.439631:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684255.439738:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073188480 00000100:00100000:3.0:1788684255.439763:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073188480 00000100:00100000:3.0:1788684255.439837:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 223 00000100:00100000:3.0:1788684255.439875:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+59:12454:x1875571073188480:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684255.439907:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684255.439911:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788684255.439945:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad1a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d78 expref: 59 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.439970:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:3.0:1788684255.439976:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788684255.439994:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad22c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3d9b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.440142:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad233 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.440159:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.440170:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684255.440182:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788684255.440326:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad22c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d9b expref: 61 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.440343:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad233 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d9b expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.440351:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:3.0:1788684255.440354:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684255.440441:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711ca00, rc 0) 00000100:00100000:3.0:1788684255.440527:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:12454:x1875571073188480:12345-192.168.206.44@tcp:101:bash.0 Request processed in 663us (910us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788684255.440715:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 223 00000100:00100000:0.0:1788684255.445877:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684255.445929:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.446133:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073188736 00000100:00100000:2.0:1788684255.446145:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073188736 00000100:00100000:2.0:1788684255.446219:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 224 00000100:00100000:2.0:1788684255.446232:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:12454:x1875571073188736:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684255.446263:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684255.446303:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad241 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3da2 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.446407:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.446424:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.446437:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.446589:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da2 expref: 62 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.446610:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da2 expref: 61 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.446621:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.446625:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788684255.446629:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5200, rc 0) 00000100:00100000:2.0:1788684255.446701:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:12454:x1875571073188736:12345-192.168.206.44@tcp:101:bash.0 Request processed in 471us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.446709:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 224 00000100:00100000:1.0:1788684255.447593:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073188608 00000100:00100000:1.0:1788684255.447604:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073188608 00000100:00100000:1.0:1788684255.447665:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684255.447675:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+61:2392:x1875571073188608:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684255.447690:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684255.447713:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad233 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d9b expref: 61 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.447730:0:9510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:1.0:1788684255.447734:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684255.447802:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:2392:x1875571073188608:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 128us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684255.447809:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:0.0:1788684255.453708:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.453808:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073188992 00000100:00100000:2.0:1788684255.453821:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073188992 00000100:00100000:2.0:1788684255.453907:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 225 00000100:00100000:2.0:1788684255.453919:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66487bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+60:12454:x1875571073188992:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:2.0:1788684255.453993:0:7963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684255.454036:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad217 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d94 expref: 60 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.454078:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.454085:0:7963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684255.454327:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.454344:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.454356:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684255.454775:0:7963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:2.0:1788684255.454808:0:7963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006382f39 reply state 00000000e2f310e0 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.454823:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.454830:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.454834:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684255.454837:0:7963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788684255.454959:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66487bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:12454:x1875571073188992:12345-192.168.206.44@tcp:36:bash.0 Request processed in 1041us (1267us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788684255.454968:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 225 00000020:00080000:2.0:1788684255.454975:0:7963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788684255.457237:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684255.457641:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073189120 00000100:00100000:0.0:1788684255.457653:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073189120 00000100:00100000:0.0:1788684255.457724:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 226 00000100:00100000:0.0:1788684255.457736:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+62:12454:x1875571073189120:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1788684255.457765:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684255.457807:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad256 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3da9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.457927:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.457943:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.457956:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684255.457991:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788684255.457996:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684255.458142:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.458173:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ad256 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da9 expref: 64 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.458192:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da9 expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.458207:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:0.0:1788684255.458210:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684255.458214:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890800, rc 0) 00000100:00100000:0.0:1788684255.458358:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:12454:x1875571073189120:12345-192.168.206.44@tcp:101:bash.0 Request processed in 624us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684255.458528:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 226 00000100:00100000:0.0:1788684255.461836:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.462071:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073189376 00000100:00100000:2.0:1788684255.462084:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073189376 00000100:00100000:2.0:1788684255.462151:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:2.0:1788684255.462163:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+63:12454:x1875571073189376:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:2.0:1788684255.463256:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12454:x1875571073189376:12345-192.168.206.44@tcp:35:bash.0 Request processed in 1085us (1423us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788684255.463269:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1788684255.544880:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.545074:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073189504 00000100:00100000:2.0:1788684255.545088:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073189504 00000100:00100000:2.0:1788684255.545186:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 227 00000100:00100000:2.0:1788684255.545198:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+64:12460:x1875571073189504:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684255.545230:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684255.545258:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad264 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3db0 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.545347:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad26b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.545396:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad26b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.545422:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad26b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684255.545482:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788684255.545486:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684255.545510:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad26b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.545549:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad264 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db0 expref: 66 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.545573:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad26b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db0 expref: 65 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.545602:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684255.545606:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684255.545610:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684255.545752:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12460:x1875571073189504:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 555us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.545760:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 227 00000100:00100000:1.0:1788684255.549732:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.549888:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073189632 00000100:00100000:2.0:1788684255.549901:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073189632 00000100:00100000:2.0:1788684255.550003:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 228 00000100:00100000:2.0:1788684255.550015:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12460:x1875571073189632:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684255.550040:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684255.550066:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad272 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3db7 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.553857:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.553889:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.553903:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.553920:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.553928:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.553960:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554058:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554069:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554077:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684255.554146:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788684255.554151:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684255.554346:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554362:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554516:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554524:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554531:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554548:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684255.554553:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554571:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554587:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684255.554590:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684255.554596:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554603:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad279 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554618:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554623:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554629:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554635:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684255.554638:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554643:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554650:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580100) 00010000:00010000:2.0:1788684255.554652:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684255.554655:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554672:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4e00/0x44bac02bd54ad280 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554713:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ad272 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db7 expref: 67 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554729:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db7 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.554736:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.554739:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684255.554741:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4c00, rc 0) 00000100:00100000:2.0:1788684255.554952:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12460:x1875571073189632:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 4937us (5230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.554962:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 228 00000100:00100000:1.0:1788684255.559017:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684255.559117:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073189888 00000100:00100000:0.0:1788684255.559130:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073189888 00000100:00100000:0.0:1788684255.559211:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 229 00000100:00100000:0.0:1788684255.559223:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12460:x1875571073189888:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684255.559249:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684255.559274:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ad28e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3dbe expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.559459:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.559477:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da9 expref: 67 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.559487:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db7 expref: 67 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.559496:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.559551:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db7 expref: 67 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.559567:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db7 expref: 67 pid: 6498 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684255.559583:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a63480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085815936:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684255.559700:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da9 expref: 67 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684255.559728:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da9 expref: 67 pid: 6497 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684255.559739:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085816064:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684255.559765:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67453983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684255.562352:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a63480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085815936:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684255.564053:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.564140:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073190016 00000100:00100000:2.0:1788684255.564152:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073190016 00010000:00010000:2.0:1788684255.564218:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db7 expref: 68 pid: 6498 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684255.564264:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:2.0:1788684255.564276:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+68:2393:x1875571073190016:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684255.564293:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684255.564301:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db7 expref: 68 pid: 6498 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.564337:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db7 expref: 68 pid: 6498 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.564415:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad287 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db7 expref: 68 pid: 6498 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.564433:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.564439:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.564449:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.564456:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684255.564514:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:2393:x1875571073190016:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 240us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.564523:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:1.0:1788684255.567458:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085816064:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684255.567499:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684255.569772:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.570033:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073190144 00000100:00100000:2.0:1788684255.570045:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073190144 00010000:00010000:2.0:1788684255.570100:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da9 expref: 67 pid: 6497 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684255.570151:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 99 00000100:00100000:2.0:1788684255.570163:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:2392:x1875571073190144:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684255.570191:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684255.570200:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da9 expref: 67 pid: 6497 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.570233:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da9 expref: 67 pid: 6497 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.570260:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890800/0x44bac02bd54ad25d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da9 expref: 67 pid: 6497 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.570279:0:9510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.570285:0:9510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.570296:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.570306:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.570342:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684255.570442:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:2392:x1875571073190144:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 280us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.570450:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 99 00010000:00010000:1.0:1788684255.570573:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.570582:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684255.570606:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788684255.570777:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890c00/0x44bac02bd54ad28e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dbe expref: 67 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.570799:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dbe expref: 66 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684255.570807:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:1.0:1788684255.570810:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788684255.570813:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891c00, rc 0) 00000100:00100000:1.0:1788684255.570844:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12460:x1875571073189888:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 11624us (11840us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788684255.570852:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 229 00000100:00100000:3.0:1788684255.576036:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684255.576277:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073190400 00000100:00100000:2.0:1788684255.576290:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073190400 00000100:00100000:2.0:1788684255.576554:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:2.0:1788684255.576568:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6748349c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12460:x1875571073190400:12345-192.168.206.44@tcp:103:lfs.0 00010000:00010000:2.0:1788684255.576588:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684255.576620:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad1e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d8d expref: 66 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684255.576669:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684255.576675:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684255.576741:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6748349c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12460:x1875571073190400:12345-192.168.206.44@tcp:103:lfs.0 Request processed in 176us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684255.576750:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:1.0:1788684255.578794:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684255.578889:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073190528 00000100:00100000:3.0:1788684255.578902:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073190528 00000100:00100000:3.0:1788684255.578974:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 230 00000100:00100000:3.0:1788684255.578986:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12460:x1875571073190528:12345-192.168.206.44@tcp:58:lfs.0 00010000:00010000:3.0:1788684255.579154:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.579185:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.579198:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788684255.579325:0:12443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788684255.579473:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12460:x1875571073190528:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 487us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684255.579482:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 230 00000100:00100000:1.0:1788684255.582471:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684255.582799:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073190656 00000100:00100000:3.0:1788684255.582812:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073190656 00000100:00100000:3.0:1788684255.582884:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 231 00000100:00100000:3.0:1788684255.582897:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+65:12460:x1875571073190656:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684255.582941:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684255.582967:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3dc5 expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.583039:0:7963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.583053:0:7963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dc5 expref: 66 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.583075:0:7963:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.583092:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dc5 expref: 66 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.583109:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:3.0:1788684255.583125:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788684255.583130:0:7963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dc5 expref: 66 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684255.583138:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d400, rc 0) 00000100:00100000:3.0:1788684255.583216:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12460:x1875571073190656:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 321us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684255.583223:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 231 00010000:00010000:0.0:1788684255.870405:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788684256.254277:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684256.254290:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684256.255821:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788684256.255846:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684256.256068:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a62a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085816192:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788684256.258784:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684256.279650:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.279798:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073190784 00000100:00100000:2.0:1788684256.279811:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073190784 00000100:00100000:2.0:1788684256.279896:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 232 00000100:00100000:2.0:1788684256.279909:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:12461:x1875571073190784:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788684256.279954:0:13784:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788684256.280094:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:12461:x1875571073190784:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 188us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.280102:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 232 00000100:00100000:0.0:1788684256.284842:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a62a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085816192:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788684256.300023:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684256.300610:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073190912 00000100:00100000:3.0:1788684256.300823:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073190912 00000100:00100000:3.0:1788684256.300975:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 233 00000100:00100000:3.0:1788684256.300986:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12461:x1875571073190912:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788684256.301083:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301104:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301136:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301166:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301175:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301182:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301209:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301218:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301224:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684256.301282:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788684256.301288:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684256.301303:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301325:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301332:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301340:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301346:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684256.301351:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301359:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301435:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:3.0:1788684256.301439:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684256.301445:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301452:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711cc00/0x44bac02bd54ad2b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301468:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301475:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301481:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301492:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684256.301496:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301502:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301510:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8d6750b6fc00) 00010000:00010000:3.0:1788684256.301513:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684256.301515:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301521:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad2b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301547:0:12443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301554:0:12443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301559:0:12443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301565:0:12443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711de00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684256.301568:0:12443:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301574:0:12443:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301591:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:3.0:1788684256.301593:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684256.301596:0:12443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.301602:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad2bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684256.301706:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12461:x1875571073190912:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 721us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684256.301715:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 233 00000100:00100000:1.0:1788684256.308941:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684256.309062:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073191168 00000100:00100000:3.0:1788684256.309075:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073191168 00000100:00100000:3.0:1788684256.309572:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 234 00000100:00100000:3.0:1788684256.309587:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+66:12461:x1875571073191168:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684256.309614:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684256.310249:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad2c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3dcc expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.310912:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.310938:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.310953:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684256.310970:0:7963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788684256.311097:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.311105:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.311111:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.311118:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684256.311123:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.311130:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.314836:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:3.0:1788684256.314850:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788684256.314862:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.314874:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad2cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.314972:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad2c6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dcc expref: 68 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.314986:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:3.0:1788684256.314989:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684256.314993:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad2c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dcc expref: 68 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.315032:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711ca00, rc 0) 00000100:00100000:3.0:1788684256.315126:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:12461:x1875571073191168:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 5542us (6199us total) trans 4294967506 rc 301/301 00000100:00100000:3.0:1788684256.315136:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 234 00000100:00100000:1.0:1788684256.320149:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.320606:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073191296 00000100:00100000:2.0:1788684256.320628:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073191296 00000100:00100000:2.0:1788684256.320718:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 235 00000100:00100000:2.0:1788684256.320732:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:12461:x1875571073191296:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788684256.320793:0:13784:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788684256.320949:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:12461:x1875571073191296:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 220us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.320957:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 235 00000100:00100000:2.0:1788684256.338899:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.339049:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073191552 00000100:00100000:1.0:1788684256.339064:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073191552 00000100:00100000:1.0:1788684256.339165:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 236 00000100:00100000:1.0:1788684256.339178:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:12461:x1875571073191552:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684256.339206:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684256.339210:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788684256.339244:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad26b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3db0 expref: 67 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.339268:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:1.0:1788684256.339274:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684256.339295:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ad2db lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3dd3 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788684256.339880:0:6499:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788684256.340072:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad2e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.340090:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.340102:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.340165:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ad2db lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dd3 expref: 69 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.340183:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dd3 expref: 68 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.340193:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6641867e00) 00010000:00010000:1.0:1788684256.340209:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788684256.340213:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0e00, rc 0) 00000100:00100000:1.0:1788684256.340296:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+68:12461:x1875571073191552:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1121us (1413us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788684256.340305:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 236 00000100:00100000:1.0:1788684256.356992:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.357105:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073191808 00000100:00100000:2.0:1788684256.357119:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073191808 00000100:00100000:2.0:1788684256.357219:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 237 00000100:00100000:2.0:1788684256.357230:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6748968050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+68:12461:x1875571073191808:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788684256.357307:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684256.357341:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad2e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dd3 expref: 68 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357481:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6641867e00) 00010000:00010000:2.0:1788684256.357497:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684256.357524:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357552:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357564:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357581:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357589:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357596:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357662:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357671:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357689:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357695:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684256.357700:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357709:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357717:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684256.357720:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684256.357725:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357732:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad2f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357742:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357749:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357755:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357760:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684256.357763:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357779:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357788:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x33c32dfb (ffff8d6647580700) 00010000:00010000:2.0:1788684256.357790:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684256.357794:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.357799:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad2f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x33c32dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.357908:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6748968050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:12461:x1875571073191808:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 679us (930us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788684256.357917:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 237 00000100:00100000:1.0:1788684256.363753:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.363907:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073191936 00000100:00100000:2.0:1788684256.363920:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073191936 00000100:00100000:2.0:1788684256.363995:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 238 00000100:00100000:2.0:1788684256.364007:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+67:12461:x1875571073191936:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684256.364035:0:7963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684256.364065:0:7963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad2fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3dda expref: -99 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.364114:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.364133:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.364146:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.364305:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad2fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dda expref: 69 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.364328:0:7963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dda expref: 68 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.364339:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:2.0:1788684256.364343:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788684256.364347:0:7963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5a00, rc 0) 00000100:00100000:2.0:1788684256.364472:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+68:12461:x1875571073191936:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 466us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.364481:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 238 00000100:00100000:1.0:1788684256.374227:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684256.379599:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073192192 00000100:00100000:0.0:1788684256.379814:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073192192 00000100:00100000:0.0:1788684256.379976:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 239 00000100:00100000:0.0:1788684256.379990:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+68:12461:x1875571073192192:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788684256.380106:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.380141:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.380157:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684256.380610:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788684256.380634:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337374266874ns, next at 338374263517ns, rc = 0 00000004:00010000:0.0:1788684256.380700:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2df91c7 reply state 000000006954ec2b transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.380716:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.380725:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:0.0:1788684256.380728:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788684256.380732:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788684256.381073:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+70:12461:x1875571073192192:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 1082us (6853us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788684256.381083:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 239 00000100:00100000:1.0:1788684256.391612:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684256.394950:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073192320 00000100:00100000:0.0:1788684256.394971:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073192320 00000100:00100000:1.0:1788684256.399352:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 240 00000100:00100000:1.0:1788684256.399388:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+70:12461:x1875571073192320:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684256.399431:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684256.399469:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3de1 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.399567:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de1 expref: 71 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.399587:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de1 expref: 71 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.399615:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:1.0:1788684256.399632:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684256.399637:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1800, rc 0) 00000100:00100000:1.0:1788684256.399731:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+71:12461:x1875571073192320:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 365us (8134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684256.399739:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 240 00000100:00100000:1.0:1788684256.407636:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.407802:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073192448 00000100:00100000:2.0:1788684256.407815:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073192448 00000100:00100000:2.0:1788684256.407960:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:2.0:1788684256.407974:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2392:x1875571073192448:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788684256.408248:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:2392:x1875571073192448:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 276us (637us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788684256.408257:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:3.0:1788684256.411170:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.412572:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073192704 00000100:00100000:1.0:1788684256.412592:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073192704 00000100:00100000:1.0:1788684256.412692:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:1.0:1788684256.412705:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+71:12461:x1875571073192704:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788684256.413077:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+72:12461:x1875571073192704:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 372us (1921us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788684256.413086:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00080000:0.0:1788684256.413729:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684256.426026:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.426255:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073192960 00000100:00100000:2.0:1788684256.426268:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073192960 00000100:00100000:2.0:1788684256.426341:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 241 00000100:00100000:2.0:1788684256.426353:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+72:12461:x1875571073192960:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788684256.426561:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+72:12461:x1875571073192960:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 210us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.426595:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 241 00000100:00100000:0.0:1788684256.432123:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684256.432224:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073193088 00000100:00100000:3.0:1788684256.432236:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073193088 00000100:00100000:3.0:1788684256.432312:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 242 00000100:00100000:3.0:1788684256.432325:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+72:12461:x1875571073193088:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684256.432351:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684256.433055:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad31a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3de8 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.433159:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad321 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.433177:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad321 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.433190:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad321 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684256.433253:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684256.433278:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad321 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.433313:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ad31a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de8 expref: 74 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.433336:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad321 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de8 expref: 73 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.433346:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:2.0:1788684256.433350:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788684256.433354:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4c00, rc 0) 00000100:00100000:2.0:1788684256.433790:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+73:12461:x1875571073193088:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1465us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.433800:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 242 00000100:00100000:0.0:1788684256.450736:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684256.453841:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073193216 00000100:00100000:3.0:1788684256.453865:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073193216 00000100:00100000:2.0:1788684256.457050:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:2.0:1788684256.457068:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+10:2393:x1875571073193216:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684256.457094:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684256.457122:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3def expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684256.457153:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d27e0, blocks: 0x0 00010000:00010000:2.0:1788684256.457182:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1788684256.457186:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684256.457198:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3def expref: 11 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.457220:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3def expref: 11 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.457236:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4400, rc 0) 00000100:00100000:2.0:1788684256.457334:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:2393:x1875571073193216:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 270us (6614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.457343:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:1.0:1788684256.473976:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.474078:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073193472 00000100:00100000:2.0:1788684256.474092:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073193472 00000100:00100000:2.0:1788684256.474168:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 243 00000100:00100000:2.0:1788684256.474181:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+73:12461:x1875571073193472:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788684256.474335:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+73:12461:x1875571073193472:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 156us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.474429:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 243 00000100:00100000:0.0:1788684256.483330:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.483406:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073193600 00000100:00100000:2.0:1788684256.483419:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073193600 00000100:00100000:2.0:1788684256.483494:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:2.0:1788684256.483506:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:12461:x1875571073193600:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684256.483542:0:9991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684256.483566:0:9991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3df6 expref: -99 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.483609:0:9991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3def expref: 12 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.483620:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684256.483625:0:9991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684256.483631:0:9991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 12 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.483675:0:9991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3def expref: 12 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.483691:0:9991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3def expref: 12 pid: 8413 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.483708:0:9991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9991:1875571085816320:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684256.484624:0:9991:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788684256.490216:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.490327:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073193728 00000100:00100000:1.0:1788684256.490339:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073193728 00010000:00010000:1.0:1788684256.490432:0:9510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3def expref: 13 pid: 8413 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684256.490473:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 100 00000100:00100000:1.0:1788684256.490484:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:2392:x1875571073193728:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684256.490503:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684256.490539:0:9510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3def expref: 13 pid: 8413 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.490556:0:9510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3def expref: 13 pid: 8413 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.490588:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684256.490593:0:9510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684256.490621:0:9510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 13 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.490633:0:9510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 13 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.490681:0:9510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 13 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684256.490697:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9510:1875571085816448:192.168.206.44@tcp:105: 00000100:00100000:1.0:1788684256.490816:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867ee40 going to sleep for 11 seconds 00010000:00010000:2.0:1788684256.497086:0:9991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad328 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3def expref: 13 pid: 8413 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.497120:0:9991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9991:1875571085816320:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684256.497164:0:9991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 12 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.497182:0:9991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4600, rc 0) 00000100:00100000:2.0:1788684256.497261:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:12461:x1875571073193600:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 13756us (13944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.497271:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:3.0:1788684256.500149:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.500569:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9510:1875571085816448:192.168.206.44@tcp:105: 00010000:00010000:2.0:1788684256.500601:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684256.500668:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:2392:x1875571073193728:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 10184us (10466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.500680:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 100 00000100:00100000:0.0:1788684256.501409:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073193856 00000100:00100000:0.0:1788684256.501419:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073193856 00002000:00100000:0.0:1788684256.501476:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8d6648665c00 x1875571073193856/t0(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:177/0 lens 504/0 e 0 to 0 dl 1788684267 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788684256.501487:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6648665c00 with x1875571073193856 ext(0->12) 00002000:00010000:0.0:1788684256.501492:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6648665c00 00000100:00100000:0.0:1788684256.501537:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:0.0:1788684256.501566:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+11:2392:x1875571073193856:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788684256.504936:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:2392:x1875571073193856:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 Request processed in 3356us (4784us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788684256.504952:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00002000:00100000:0.0:1788684256.504969:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8d6648665c00 x1875571073193856/t4294967321(0) o4->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:177/0 lens 504/448 e 0 to 0 dl 1788684267 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788684256.504980:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6648665c00 with x1875571073193856 ext(0->12) 00002000:00010000:0.0:1788684256.504988:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6648665c00 00000100:00100000:1.0:1788684256.507985:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.508174:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073193984 00000100:00100000:2.0:1788684256.508186:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073193984 00000100:00100000:2.0:1788684256.508261:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:2.0:1788684256.508274:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+73:12461:x1875571073193984:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788684256.511477:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:3.0:1788684256.511504:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788684256.511546:0:6476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788684256.511787:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085816576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788684256.511880:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684256.511952:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085816704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788684256.511982:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684256.512024:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085816576 00000100:00100000:0.0:1788684256.512033:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085816576 00000100:00100000:0.0:1788684256.512097:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085816704 00000100:00100000:0.0:1788684256.512101:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085816704 00000100:00100000:0.0:1788684256.512123:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788684256.512132:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3626:x1875571085816576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788684256.512166:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1788684256.512200:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.512227:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d4e expref: 12 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.512260:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788684256.512267:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788684256.512273:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.512308:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d4e expref: 12 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.512325:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d4e expref: 12 pid: 8413 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684256.512339:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875571085816832:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684256.512439:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398480 going to sleep for 11 seconds 00000100:00080000:0.0:1788684256.512453:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684256.512468:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788684256.512476:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3623:x1875571085816704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788684256.512617:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788684256.512621:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788684256 00002000:00010000:0.0:1788684256.512624:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788684256.512626:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788684256 -> 1788684256 00002000:00010000:0.0:1788684256.512629:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788684256.512678:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3623:x1875571085816704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (694us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788684256.512686:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1788684256.512749:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d6647a60700/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788684256.512756:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085816704:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788684256.513023:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513036:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513044:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513051:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.513056:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513065:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513084:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8d6641869900) 00010000:00010000:1.0:1788684256.513094:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684256.513100:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513106:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ad034 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513140:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513147:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513152:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513157:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.513160:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513166:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513175:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684256.513177:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684256.513180:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513186:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ad0dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513203:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513219:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513225:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513230:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.513233:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513239:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513249:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580100) 00010000:00010000:1.0:1788684256.513251:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684256.513255:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513260:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ad15a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513276:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513283:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513289:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513294:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.513307:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513314:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513323:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6647580100) 00010000:00010000:1.0:1788684256.513326:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684256.513328:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513334:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad17d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513352:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513358:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513363:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513409:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.513412:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513418:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513427:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:1.0:1788684256.513430:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684256.513440:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513446:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad24f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513460:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513467:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513472:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513478:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.513481:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513488:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513497:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:1.0:1788684256.513500:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788684256.513503:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.513509:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891800/0x44bac02bd54ad30c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684256.516358:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085816960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788684256.516559:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684256.517038:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085816960 00000100:00100000:2.0:1788684256.517049:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085816960 00000100:00100000:2.0:1788684256.517126:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788684256.517138:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085816960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788684256.517176:0:8411:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1788684256.517238:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9d27de, atime: 0x0, ctime: 0x6a9d27de, blocks: 0x8 00010000:00010000:2.0:1788684256.517248:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.517270:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1788684256.517275:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684256.517285:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.517303:0:8411:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.517314:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.517323:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.517351:0:8411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684256.517405:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684256.517415:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.517439:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684256.517444:0:9499:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.517455:0:9499:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.517477:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.517485:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad33d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.517515:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684256.517517:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684256.517520:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788684256.517787:0:6476:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d664867ef00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788684256.517793:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d677e3fe400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d664867e780 00000020:00080000:3.0:1788684256.517796:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d677e3feb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d6747d14200 00000020:00080000:1.0:1788684256.517846:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788684256.517861:0:6476:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d664867ec00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788684256.517865:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6777040400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d664867e300 00000020:00080000:3.0:1788684256.517869:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6777040d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d6646d35000 00000020:00080000:1.0:1788684256.518002:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788684256.518081:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788684256.520773:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085816960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3624us (4199us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788684256.520790:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788684256.520997:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12461:x1875571073193984:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 12723us (13022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.521007:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 244 00000004:00080000:0.0:1788684256.521344:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d664876d880/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788684256.521353:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085816960:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788684256.521716:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875571085816832:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684256.521750:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684256.521797:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.522241:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073194112 00000100:00100000:2.0:1788684256.522251:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073194112 00010000:00010000:2.0:1788684256.522304:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d4e expref: 13 pid: 8413 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.522353:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 101 00000100:00100000:2.0:1788684256.522406:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+13:2392:x1875571073194112:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684256.522426:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684256.522433:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d4e expref: 13 pid: 8413 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.522448:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d4e expref: 13 pid: 8413 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.522475:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cbf5325/0x44bac02bd54ad0ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d4e expref: 13 pid: 8413 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.522495:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684256.522500:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684256.522506:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.522517:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.522559:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684256.522778:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:2392:x1875571073194112:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 415us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.522798:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 101 00010000:00010000:3.0:1788684256.522878:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.522889:0:8413:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.522901:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.522910:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.522936:0:8413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788684256.523177:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3626:x1875571085816576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11044us (11296us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788684256.523186:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788684256.523540:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d6647a60a80/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788684256.523549:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085816576:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788684256.523632:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684256.523640:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.523651:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684256.523655:0:6485:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.523666:0:6485:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.523683:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.523692:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eded0393/0x44bac02bd54ad336 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.523715:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684256.523717:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684256.523719:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684256.525515:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.527094:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073194240 00000100:00100000:2.0:1788684256.527115:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073194240 00000100:00100000:2.0:1788684256.527196:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:2.0:1788684256.527207:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+12:2393:x1875571073194240:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788684256.533221:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788684256.533250:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1788684256.534297:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2393:x1875571073194240:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 7076us (8777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684256.534313:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:0.0:1788684256.541087:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.541382:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073194496 00000100:00100000:1.0:1788684256.541397:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073194496 00000100:00100000:1.0:1788684256.541479:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:1.0:1788684256.541491:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12461:x1875571073194496:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788684256.541618:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684256.541655:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad321 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de8 expref: 21 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.541676:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:1.0:1788684256.541682:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684256.541721:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.541738:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.541748:0:6499:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684256.541914:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040668f79 reply state 000000005488b365 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.541928:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.541934:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:1.0:1788684256.541937:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684256.541940:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788684256.542082:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:12461:x1875571073194496:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 592us (1010us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1788684256.542091:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:1.0:1788684256.555332:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.555890:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073194624 00000100:00100000:2.0:1788684256.555904:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073194624 00000100:00100000:2.0:1788684256.555971:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:2.0:1788684256.555981:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073194624:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788684256.556132:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788684256.556136:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788684256 -> 1788684255 00002000:00010000:2.0:1788684256.556138:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788684255 00002000:00010000:2.0:1788684256.556140:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788684256 -> 1788684255 00002000:00010000:2.0:1788684256.556142:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788684256.556204:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073194624:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 224us (885us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788684256.556212:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:3.0:1788684256.558448:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.558766:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073194880 00000100:00100000:2.0:1788684256.558779:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073194880 00000100:00100000:2.0:1788684256.559244:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 246 00000100:00100000:2.0:1788684256.559255:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:12461:x1875571073194880:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788684256.559319:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.559335:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dda expref: 22 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.559344:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.559471:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dda expref: 22 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.559504:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dda expref: 22 pid: 7963 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.559517:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875571085817088:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684256.559750:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684256.567845:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.568659:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073195008 00000100:00100000:1.0:1788684256.568669:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073195008 00010000:00010000:1.0:1788684256.568725:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dda expref: 23 pid: 7963 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684256.568765:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 102 00000100:00100000:1.0:1788684256.568774:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:2393:x1875571073195008:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684256.568788:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684256.568795:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dda expref: 23 pid: 7963 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.568808:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dda expref: 23 pid: 7963 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.568830:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:1.0:1788684256.568835:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.568846:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.568853:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.568872:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684256.568926:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+23:2393:x1875571073195008:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 153us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684256.568933:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 102 00010000:00010000:2.0:1788684256.571170:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ad305 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dda expref: 22 pid: 7963 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.571248:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6498:1875571085817088:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684256.571274:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.571285:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.571291:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.571334:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.571342:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.571350:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.571355:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684256.571412:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.571421:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.571435:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:2.0:1788684256.571438:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788684256.571442:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.571449:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad34b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.571512:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12461:x1875571073194880:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 Request processed in 12258us (13077us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788684256.571520:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 246 00000100:00100000:0.0:1788684256.575085:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.575155:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073195136 00000100:00100000:2.0:1788684256.575164:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073195136 00000100:00100000:2.0:1788684256.575216:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:2.0:1788684256.575226:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073195136:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788684256.575266:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.575286:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 8 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.575295:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684256.575299:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684256.575316:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.575349:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 8 pid: 9991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.575361:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 8 pid: 9991 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.575408:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875571085817216:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684256.575480:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788684256.577184:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875571085817216:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684256.577208:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684256.577945:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.578250:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073195264 00000100:00100000:2.0:1788684256.578257:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073195264 00010000:00010000:2.0:1788684256.578288:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 9 pid: 9991 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.578325:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 103 00000100:00100000:2.0:1788684256.578333:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+9:2393:x1875571073195264:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684256.578346:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684256.578477:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 9 pid: 9991 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.578505:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 9 pid: 9991 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.578526:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad32f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3df6 expref: 9 pid: 9991 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.578553:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684256.578564:0:6484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684256.578570:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.578579:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.578609:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684256.578691:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2393:x1875571073195264:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 358us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.578698:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 103 00010000:00010000:3.0:1788684256.579569:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.579581:0:8411:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.579603:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.579626:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.579634:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.579640:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684256.579644:0:8411:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.579653:0:8411:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.579668:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.579675:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ad352 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684256.579737:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073195136:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 4511us (4660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684256.579757:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:0.0:1788684256.601698:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684256.601784:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073195520 00000100:00100000:3.0:1788684256.601863:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073195520 00000100:00100000:3.0:1788684256.601920:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 247 00000100:00100000:3.0:1788684256.601942:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:12461:x1875571073195520:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788684256.602014:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.602029:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da2 expref: 21 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.602039:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.602069:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da2 expref: 21 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.602083:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da2 expref: 21 pid: 12443 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684256.602096:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085817344:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684256.602169:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750a08a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684256.607658:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085817344:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684256.607697:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684256.608014:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.608111:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073195648 00000100:00100000:1.0:1788684256.608127:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073195648 00010000:00010000:1.0:1788684256.608180:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da2 expref: 22 pid: 12443 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684256.608243:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 104 00000100:00100000:1.0:1788684256.608252:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:2392:x1875571073195648:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684256.608269:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684256.608276:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da2 expref: 22 pid: 12443 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.608290:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da2 expref: 22 pid: 12443 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.608315:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ad248 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3da2 expref: 22 pid: 12443 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.608333:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:1.0:1788684256.608340:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dc5 expref: 21 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.608350:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.608357:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.608495:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.608540:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684256.608598:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:2392:x1875571073195648:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 346us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684256.608613:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 104 00010000:00010000:2.0:1788684256.609128:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.609140:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.609328:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.609354:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de1 expref: 21 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.609405:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.609444:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de1 expref: 21 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.609458:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de1 expref: 21 pid: 13784 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.609473:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085817472:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684256.609566:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684256.613735:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684256.615058:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073195776 00000100:00100000:3.0:1788684256.615071:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073195776 00010000:00010000:3.0:1788684256.615113:0:6484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de1 expref: 22 pid: 13784 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684256.615158:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 105 00000100:00100000:3.0:1788684256.615186:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:2393:x1875571073195776:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684256.615205:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684256.615213:0:6484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de1 expref: 22 pid: 13784 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.615227:0:6484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de1 expref: 22 pid: 13784 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.615251:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:3.0:1788684256.615257:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.615267:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.615275:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684256.615293:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684256.615360:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:2393:x1875571073195776:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 181us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684256.615390:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 105 00010000:00010000:2.0:1788684256.616564:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ad313 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3de1 expref: 21 pid: 13784 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.616588:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085817472:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684256.616612:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.616621:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.616628:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684256.616743:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788684256.616889:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788684256.616923:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788684256.617021:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875571085817600:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788684256.617173:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684256.617218:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6756201840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684256.617560:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085817600 00000100:00100000:0.0:1788684256.617566:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085817600 00000100:00100000:0.0:1788684256.617619:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788684256.617630:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6497:x1875571085817600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788684256.617714:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6497:x1875571085817600:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684256.617721:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788684256.617948:0:6497:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1788684256.617954:0:6497:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:2.0:1788684256.617972:0:6497:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d6647a60700, transno 4294967322 00000004:00080000:2.0:1788684256.617987:0:6497:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d6647a60a80, transno 4294967323 00000100:00100000:2.0:1788684256.617994:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875571085817600:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788684256.618105:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788684256.618156:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875571085817728:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788684256.618189:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684256.618258:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788684256.621994:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085817728 00000100:00100000:3.0:1788684256.622009:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085817728 00000100:00100000:0.0:1788684256.626641:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788684256.626668:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6497:x1875571085817728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788684256.627000:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6497:x1875571085817728:12345-0@lo:1000:mdt00_000.0 Request processed in 335us (8809us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788684256.627007:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788684256.629730:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6497:1875571085817728:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788684256.637597:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637614:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637623:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637629:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.637634:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637643:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637661:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:1.0:1788684256.637664:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684256.637669:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637675:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad360 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637701:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637708:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637714:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637738:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.637741:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637748:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637758:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:1.0:1788684256.637760:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684256.637768:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dc5 expref: 24 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637781:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dc5 expref: 24 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637864:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dc5 expref: 24 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.637910:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dc5 expref: 24 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684256.637925:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085817856:192.168.206.44@tcp:105: 00000100:00100000:1.0:1788684256.638069:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684256.654159:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.654264:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073195904 00000100:00100000:2.0:1788684256.654280:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073195904 00000100:00100000:1.0:1788684256.654334:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6497:1875571085817856:192.168.206.44@tcp:105: 00000100:00100000:2.0:1788684256.654405:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:2.0:1788684256.654418:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:12460:x1875571073195904:12345-192.168.206.44@tcp:49:lfs.0 00010000:00010000:1.0:1788684256.654435:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654478:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d000/0x44bac02bd54ad2a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654524:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.654556:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+25:12460:x1875571073195904:12345-192.168.206.44@tcp:49:lfs.0 Request processed in 139us (412us total) trans 0 rc 0/0 00010000:00010000:1.0:1788684256.654557:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654576:0:6497:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.654578:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00010000:00010000:1.0:1788684256.654598:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654607:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654615:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654623:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.654628:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654636:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654649:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:1.0:1788684256.654653:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684256.654657:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654670:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad367 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654690:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654697:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654704:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654710:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711ca00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684256.654714:0:6497:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654720:0:6497:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654733:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:1.0:1788684256.654736:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788684256.654739:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.654746:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711ca00/0x44bac02bd54ad359 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684256.654981:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:12461:x1875571073195520:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 53034us (53285us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788684256.654995:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 247 00000020:00080000:1.0:1788684256.655010:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788684256.655069:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684256.655075:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684256.657213:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788684256.657227:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684256.660640:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.660715:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073196160 00000100:00100000:1.0:1788684256.660736:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073196160 00000100:00100000:1.0:1788684256.660836:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 248 00000100:00100000:1.0:1788684256.660849:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:12460:x1875571073196160:12345-192.168.206.44@tcp:58:lfs.0 00000040:00080000:1.0:1788684256.661084:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788684256.661214:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:12460:x1875571073196160:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 366us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684256.661223:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 248 00000100:00100000:0.0:1788684256.668307:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684256.668513:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073196416 00000100:00100000:2.0:1788684256.668524:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073196416 00000100:00100000:2.0:1788684256.668603:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:2.0:1788684256.668614:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749554450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+24:12461:x1875571073196416:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788684256.668877:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788684256.668909:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:2.0:1788684256.668959:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.668974:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.668984:0:6500:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.668992:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.668997:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.669003:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.669017:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788684256.669096:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749554450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+26:12461:x1875571073196416:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 484us (798us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788684256.669105:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00000020:00080000:2.0:1788684256.669109:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788684256.670403:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684256.670414:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.670425:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684256.670430:0:6486:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.670440:0:6486:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.670457:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:0.0:1788684256.670460:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788684256.670465:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.670472:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad36e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684256.670503:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684256.670505:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684256.670507:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684256.711266:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.711342:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073196544 00000100:00100000:1.0:1788684256.711351:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073196544 00000100:00100000:1.0:1788684256.711508:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 249 00000100:00100000:1.0:1788684256.711517:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+26:12463:x1875571073196544:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684256.711550:0:13784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684256.711569:0:13784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad375 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3dfd expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711622:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711634:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711644:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711658:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711665:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711684:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711750:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711760:0:13784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dbe expref: 27 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711768:0:13784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711908:0:13784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dbe expref: 27 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.711922:0:13784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dbe expref: 27 pid: 6497 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684256.711935:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13784:1875571085817984:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684256.712053:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684256.726027:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13784:1875571085817984:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684256.726057:0:13784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684256.726172:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.726747:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073196800 00000100:00100000:1.0:1788684256.726755:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073196800 00000100:00100000:1.0:1788684256.726817:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:1.0:1788684256.726828:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+28:6159:x1875571073196800:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788684256.727475:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:6159:x1875571073196800:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 647us (1302us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788684256.727485:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:2.0:1788684256.743270:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684256.743433:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073196928 00000100:00100000:1.0:1788684256.743443:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073196928 00010000:00010000:1.0:1788684256.743482:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dbe expref: 29 pid: 6497 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684256.743526:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00100000:1.0:1788684256.743547:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:2393:x1875571073196928:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684256.743560:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684256.743566:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dbe expref: 29 pid: 6497 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.743578:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dbe expref: 29 pid: 6497 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.743599:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ad295 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dbe expref: 29 pid: 6497 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.743614:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:1.0:1788684256.743619:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.743628:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.743636:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684256.743685:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684256.743744:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+28:2393:x1875571073196928:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 199us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684256.743751:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 106 00010000:00010000:2.0:1788684256.744550:0:13784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744561:0:13784:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684256.744609:0:13784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788684256.744621:0:13784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684256.744643:0:13784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744656:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744666:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744672:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744679:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744684:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684256.744688:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744695:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744705:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684256.744709:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684256.744712:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744719:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ad37c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744730:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744746:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744751:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744757:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684256.744760:0:13784:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744766:0:13784:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744776:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8d6641867300) 00010000:00010000:2.0:1788684256.744779:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684256.744781:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744800:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ad383 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744839:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ad375 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dfd expref: 28 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744854:0:13784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dfd expref: 27 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684256.744862:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684256.744864:0:13784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684256.744873:0:13784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1000, rc 0) 00000100:00100000:2.0:1788684256.744921:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:12463:x1875571073196544:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 33405us (33663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684256.744929:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 249 00010000:00010000:0.0:1788684256.893761:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788684257.583599:0:14735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788684257.583608:0:14735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788684257.583644:0:14735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788684257.583652:0:14735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788684257.662175:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788684257.662185:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684257.662209:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788684257.662216:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684257.662338:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a62d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085818112:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788684257.662852:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677726c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788684257.668794:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a62d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875571085818112:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788684257.676402:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684257.676516:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073197056 00000100:00100000:2.0:1788684257.676535:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073197056 00000100:00100000:2.0:1788684257.676603:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 250 00000100:00100000:2.0:1788684257.676613:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:12474:x1875571073197056:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788684257.676644:0:7963:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788684257.676758:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:12474:x1875571073197056:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 134us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684257.676766:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 250 00000100:00080000:1.0:1788684257.677081:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684257.689307:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684257.689413:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073197312 00000100:00100000:3.0:1788684257.689422:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073197312 00000100:00100000:3.0:1788684257.689474:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 251 00000100:00100000:3.0:1788684257.689484:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+27:12474:x1875571073197312:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684257.689503:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684257.689532:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad391 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3e04 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.689647:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.689663:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.689676:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684257.689687:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788684257.689794:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c000/0x44bac02bd54ad391 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e04 expref: 30 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.689812:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e04 expref: 29 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.689820:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:3.0:1788684257.689823:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788684257.689827:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711de00, rc 0) 00000100:00100000:3.0:1788684257.689887:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:12474:x1875571073197312:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 405us (780us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788684257.689907:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 251 00000100:00100000:3.0:1788684257.693358:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684257.693421:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073197568 00000100:00100000:3.0:1788684257.693430:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073197568 00000100:00100000:3.0:1788684257.693472:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 252 00000100:00100000:3.0:1788684257.693482:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:12474:x1875571073197568:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788684257.693566:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.693583:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.693594:0:6498:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.693734:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.693742:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.693762:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.693768:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684257.693773:0:6498:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.693781:0:6498:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.693806:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:3.0:1788684257.693809:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788684257.693814:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.693820:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c600/0x44bac02bd54ad3a6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684257.693927:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:12474:x1875571073197568:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 446us (578us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788684257.693934:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 252 00000040:00080000:3.0:1788684257.694021:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788684257.694026:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788684257.694545:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788684257.694553:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684257.697962:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684257.698768:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684257.698981:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073197696 00000100:00100000:3.0:1788684257.698990:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073197696 00000100:00100000:3.0:1788684257.699051:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1788684257.699063:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:2391:x1875571073197696:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684257.699077:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684257.699099:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711de00/0x44bac02bd54ad398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e04 expref: 30 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684257.699125:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:3.0:1788684257.699130:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684257.699183:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:2391:x1875571073197696:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 123us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684257.699200:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1788684257.700349:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073197952 00000100:00100000:2.0:1788684257.700360:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073197952 00000100:00100000:2.0:1788684257.700627:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:2.0:1788684257.700637:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+29:12474:x1875571073197952:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788684257.700855:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:12474:x1875571073197952:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 219us (2089us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788684257.700863:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00010000:00010000:3.0:1788684257.918512:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684257.977446:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684257.977489:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684257.977518:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684257.977552:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684257.977579:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684257.977601:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684257.977629:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073198080 00000100:00100000:0.0:1788684257.977638:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073198080 00000100:00100000:0.0:1788684257.977684:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 387 00000100:00100000:0.0:1788684257.977692:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073198080:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684257.977754:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073198080:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684257.977773:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 387 00000100:00100000:3.0:1788684257.977866:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073198464 00000100:00100000:3.0:1788684257.977877:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073198464 00000100:00100000:3.0:1788684257.977920:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073198336 00000100:00100000:3.0:1788684257.977923:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073198336 00000100:00100000:3.0:1788684257.977959:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 117 00000100:00100000:3.0:1788684257.977972:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2391:x1875571073198464:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684257.978012:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2391:x1875571073198464:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 46us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684257.978024:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 117 00000100:00100000:3.0:1788684257.978036:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:3.0:1788684257.978043:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073198336:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684257.978065:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073198336:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684257.978082:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:3.0:1788684257.978099:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073198208 00000100:00100000:3.0:1788684257.978103:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073198208 00000100:00100000:3.0:1788684257.978145:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073198720 00000100:00100000:3.0:1788684257.978148:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073198720 00000100:00100000:3.0:1788684257.978307:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073198592 00000100:00100000:3.0:1788684257.978311:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073198592 00000100:00100000:3.0:1788684257.978338:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 310 00000100:00100000:3.0:1788684257.978345:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073198208:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684257.978496:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073198208:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 146us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684257.978529:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 310 00000100:00100000:3.0:1788684257.978544:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 311 00000100:00100000:3.0:1788684257.978550:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073198720:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684257.978576:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073198720:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684257.978581:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 311 00000100:00100000:3.0:1788684257.978591:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 312 00000100:00100000:3.0:1788684257.978716:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073198592:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684257.978743:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073198592:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 30us (1141us total) trans 0 rc 0/0 00000100:00080000:0.0:1788684257.978828:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684257.978836:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684257.978838:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684257.990115:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 312 00010000:00010000:0.0:1788684258.941844:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788684259.378160:0:14787:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788684259.378168:0:14787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788684259.378199:0:14787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788684259.378205:0:14787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788684259.453656:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684259.453677:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085818240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684259.453742:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684259.453801:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085818240 00000100:00100000:0.0:1788684259.453808:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085818240 00000100:00100000:0.0:1788684259.453859:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788684259.453869:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875571085818240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788684259.453897:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684259.453943:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875571085818240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684259.453951:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1788684259.453979:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684259.454021:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085818240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684259.454198:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085818624:0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.454240:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684259.454265:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085819136:0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.454301:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684259.454327:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085819648:0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.454352:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684259.454422:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788684259.454428:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085818496:0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.454454:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684259.454481:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085819008:0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.454510:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684259.454539:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085819520:0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.454562:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684259.454595:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085818624 00000100:00100000:2.0:1788684259.454599:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085818624 00000100:00100000:2.0:1788684259.454630:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788684259.454637:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085818624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.454679:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085818624:12345-0@lo:400:kworker.0 Request processed in 42us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684259.454685:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788684259.454707:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085819136 00000100:00100000:2.0:1788684259.454711:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085819136 00000100:00100000:2.0:1788684259.454741:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085818496 00000100:00100000:2.0:1788684259.454745:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085818496 00000100:00100000:2.0:1788684259.454763:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085819008 00000100:00100000:2.0:1788684259.454766:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085819008 00000100:00100000:2.0:1788684259.454780:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085819520 00000100:00100000:2.0:1788684259.454783:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085819520 00000100:00100000:2.0:1788684259.454798:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788684259.454803:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085819136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.454845:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085819136:12345-0@lo:400:kworker.0 Request processed in 41us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684259.454944:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788684259.454960:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788684259.454966:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085818496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.454998:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085818496:12345-0@lo:400:kworker.0 Request processed in 32us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684259.455004:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788684259.455017:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788684259.455024:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085819008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.455052:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085819008:12345-0@lo:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684259.455058:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788684259.455071:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788684259.455077:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085819520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.455107:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085819520:12345-0@lo:400:kworker.0 Request processed in 30us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684259.455113:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788684259.455132:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085819648 00000100:00100000:2.0:1788684259.455136:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085819648 00000100:00100000:2.0:1788684259.455167:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788684259.455174:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085819648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.455207:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085819648:12345-0@lo:400:kworker.0 Request processed in 33us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684259.455213:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788684259.455263:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684259.455267:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684259.455270:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684259.455292:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085818496:0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.455303:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085819008:0@lo:400:kworker.0 00010000:00080000:2.0:1788684259.455315:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664876d500 x1875571085819520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684259.455324:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085819520:0@lo:400:kworker.0 00000100:00100000:2.0:1788684259.455335:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085818624:0@lo:400:kworker.0 00010000:00080000:2.0:1788684259.455345:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664876dc00 x1875571085819136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684259.455353:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085819136:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.455532:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085818752:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.455566:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684259.455589:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085819264:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.455625:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684259.455645:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085819776:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.455674:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684259.455696:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788684259.455704:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085818368:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.455732:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684259.455755:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085818880:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.455778:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684259.455797:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085819392:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.455822:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684259.455852:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085818752 00000100:00100000:1.0:1788684259.455856:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085818752 00000100:00100000:1.0:1788684259.455890:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085819392 00000100:00100000:1.0:1788684259.455893:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085819392 00000100:00100000:1.0:1788684259.455920:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788684259.455926:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085818752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.455979:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085818752:12345-0@lo:400:kworker.0 Request processed in 53us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.455986:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788684259.456001:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788684259.456007:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085819392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.456036:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085819392:12345-0@lo:400:kworker.0 Request processed in 30us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.456043:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788684259.456087:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085819264 00000100:00100000:1.0:1788684259.456091:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085819264 00000100:00100000:1.0:1788684259.456115:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085819776 00000100:00100000:1.0:1788684259.456119:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085819776 00000100:00100000:1.0:1788684259.456138:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788684259.456145:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085819264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.456175:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085819264:12345-0@lo:400:kworker.0 Request processed in 31us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.456182:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788684259.456194:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788684259.456200:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085819776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.456228:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085819776:12345-0@lo:400:kworker.0 Request processed in 28us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.456234:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788684259.456255:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085818368 00000100:00100000:1.0:1788684259.456258:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085818368 00000100:00100000:1.0:1788684259.456288:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788684259.456295:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085818368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.456335:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3625:x1875571085818368:12345-0@lo:400:kworker.0 Request processed in 40us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.456342:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788684259.456402:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085818880 00000100:00100000:1.0:1788684259.456406:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085818880 00000100:00100000:1.0:1788684259.456429:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788684259.456435:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085818880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.456467:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085818880:12345-0@lo:400:kworker.0 Request processed in 33us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.456472:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788684259.456587:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085819648:0@lo:400:kworker.0 00000100:00080000:1.0:1788684259.456670:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788684259.456674:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788684259.456676:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684259.457058:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085818368:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.457128:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085818880:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.457142:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085819392:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.457153:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085818752:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.457162:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085819264:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.457171:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085819776:0@lo:400:kworker.0 00000100:00100000:1.0:1788684259.457192:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684259.457199:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085819904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684259.457235:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684259.457267:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085819904 00000100:00100000:1.0:1788684259.457271:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085819904 00000100:00100000:1.0:1788684259.457305:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788684259.457311:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085819904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684259.457328:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684259.457388:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085819904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.457394:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788684259.457427:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085819904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684259.576056:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684259.579131:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073198976 00000100:00100000:2.0:1788684259.579144:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073198976 00000100:00100000:2.0:1788684259.579236:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:2.0:1788684259.579246:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+30:12495:x1875571073198976:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684259.579267:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684259.579286:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad3ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3e0b expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684259.579438:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad3b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684259.579451:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad3b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684259.579476:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad3b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684259.579486:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00080000:1.0:1788684259.579721:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788684259.579758:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5000/0x44bac02bd54ad3ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e0b expref: 33 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684259.579792:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad3b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e0b expref: 32 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684259.579802:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:0.0:1788684259.579805:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788684259.579815:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5400, rc 0) 00000100:00100000:0.0:1788684259.579885:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:12495:x1875571073198976:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 639us (3838us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788684259.579893:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:0.0:1788684259.587498:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684259.587853:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073199104 00000100:00100000:1.0:1788684259.587862:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073199104 00000100:00100000:1.0:1788684259.587932:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00100000:1.0:1788684259.587943:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:12495:x1875571073199104:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:1.0:1788684259.588009:0:7963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.588026:0:7963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.588036:0:7963:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.588078:0:7963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.588085:0:7963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.588091:0:7963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.588119:0:7963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684259.588123:0:7963:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.588131:0:7963:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.588144:0:7963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:1.0:1788684259.588147:0:7963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684259.588151:0:7963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.588158:0:7963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0e00/0x44bac02bd54ad3c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684259.588236:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+32:12495:x1875571073199104:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 294us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.588244:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00100000:3.0:1788684259.743496:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684259.743611:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073199232 00000100:00100000:1.0:1788684259.743620:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073199232 00000100:00100000:1.0:1788684259.743701:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:1.0:1788684259.743710:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2392:x1875571073199232:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:1.0:1788684259.743727:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684259.743757:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3d247ac/0x44bac02bd54ad3c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3e12 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788684259.743781:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9d27df, atime: 0x6a9d27df, ctime: 0x6a9d27df, blocks: 0x8 00010000:00010000:1.0:1788684259.743799:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1788684259.743817:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684259.743825:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d247ac/0x44bac02bd54ad3c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e12 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.743845:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3d247ac/0x44bac02bd54ad3c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e12 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684259.743859:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0e00, rc 0) 00000100:00100000:1.0:1788684259.743916:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073199232:12345-192.168.206.44@tcp:101:cat.0 Request processed in 207us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.743924:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00080000:2.0:1788684259.744231:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684259.749555:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684259.750074:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073199360 00000100:00100000:1.0:1788684259.750084:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073199360 00002000:00100000:1.0:1788684259.750130:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8d6648667100 x1875571073199360/t0(0) o3->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:180/0 lens 488/0 e 0 to 0 dl 1788684270 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788684259.750141:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6648667100 with x1875571073199360 ext(0->4095) 00002000:00010000:1.0:1788684259.750146:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6648667100 00000100:00100000:1.0:1788684259.750182:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:1.0:1788684259.750192:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073199360:12345-192.168.206.44@tcp:3:cat.0 00000100:00100000:1.0:1788684259.750344:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+8:2392:x1875571073199360:12345-192.168.206.44@tcp:3:cat.0 Request processed in 153us (796us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788684259.750351:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00002000:00100000:1.0:1788684259.750357:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8d6648667100 x1875571073199360/t0(0) o3->0eb7f700-7065-4a98-9ec9-c4bbe6317e8e@192.168.206.44@tcp:180/0 lens 488/4536 e 0 to 0 dl 1788684270 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788684259.750412:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6648667100 with x1875571073199360 ext(0->4095) 00002000:00010000:1.0:1788684259.750428:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6648667100 00000100:00100000:0.0:1788684259.966324:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684259.966348:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085820032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684259.966448:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684259.966584:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085820032 00000100:00100000:1.0:1788684259.966594:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085820032 00000100:00100000:1.0:1788684259.966648:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788684259.966658:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085820032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684259.966686:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788684259.966732:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085820032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.966739:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788684259.966783:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085820032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684259.966998:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085820160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684259.967032:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684259.967104:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085820160 00000100:00100000:1.0:1788684259.967121:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085820160 00000100:00100000:1.0:1788684259.967158:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788684259.967166:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085820160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684259.967190:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684259.967224:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085820160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684259.967230:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788684259.967418:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085820160:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788684259.967678:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684259.967790:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684259.967801:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085820288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684259.967834:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684259.967941:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085820288 00000100:00100000:0.0:1788684259.967947:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085820288 00000100:00100000:0.0:1788684259.967983:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788684259.967992:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875571085820288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684259.968004:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788684259.968049:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1875571085820288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684259.968056:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788684259.968136:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085820288:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788684260.286492:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788684260.477817:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684260.477840:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085820416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684260.477909:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684260.478221:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085820416 00000100:00100000:2.0:1788684260.478241:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085820416 00000100:00100000:2.0:1788684260.478296:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788684260.478306:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085820416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684260.478339:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788684260.478440:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085820416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684260.478448:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788684260.478587:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085820416:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788684260.797761:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788684260.797770:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788684260.797795:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788684260.797802:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788684260.990474:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788684260.994910:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1788684262.014167:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788684262.017749:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788684262.017764:0:9488:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1788684262.019548:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788684262.019588:0:6476:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d6756201240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788684262.019607:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6749782700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d6756201840 00000020:00080000:3.0:1788684262.019610:0:6476:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6749782500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d6647999a00 00000020:00080000:1.0:1788684262.019664:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1788684262.019735:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1788684262.019914:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684262.019927:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684262.019934:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684262.019940:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684262.019944:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684262.019977:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684262.019994:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8d6647580e00) 00010000:00010000:0.0:1788684262.019997:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684262.020002:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684262.020009:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1c00/0x44bac02bd54ad344 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788684262.020659:0:6476:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1788684263.040600:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684263.114934:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684263.114971:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684263.115012:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684263.115032:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684263.115049:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684263.115066:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684263.115090:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684263.115123:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073199488 00000100:00100000:1.0:1788684263.115132:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073199488 00000100:00100000:1.0:1788684263.115177:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 389 00000100:00100000:1.0:1788684263.115186:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073199488:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684263.115248:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073199488:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 63us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684263.115256:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 389 00000100:00100000:1.0:1788684263.115297:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073199744 00000100:00100000:1.0:1788684263.115301:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073199744 00000100:00100000:1.0:1788684263.115330:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073200256 00000100:00100000:1.0:1788684263.115333:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073200256 00000100:00100000:1.0:1788684263.115347:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073199616 00000100:00100000:1.0:1788684263.115349:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073199616 00000100:00100000:1.0:1788684263.115359:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073200128 00000100:00100000:1.0:1788684263.115361:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073200128 00000100:00100000:1.0:1788684263.115398:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 319 00000100:00100000:1.0:1788684263.115405:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073199744:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684263.115434:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073199744:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684263.115441:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 319 00000100:00100000:1.0:1788684263.115452:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 320 00000100:00100000:1.0:1788684263.115458:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073200256:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684263.115505:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073200256:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 35us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684263.115516:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 320 00000100:00100000:1.0:1788684263.115530:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 321 00000100:00100000:1.0:1788684263.115536:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2390:x1875571073199616:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684263.115564:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2390:x1875571073199616:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 29us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684263.115570:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 321 00000100:00100000:1.0:1788684263.115581:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 322 00000100:00100000:1.0:1788684263.115587:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073200128:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684263.115608:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2390:x1875571073200128:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 21us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684263.115613:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 322 00000100:00100000:1.0:1788684263.115630:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073200000 00000100:00100000:1.0:1788684263.115634:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073200000 00000100:00100000:1.0:1788684263.115657:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073199872 00000100:00100000:1.0:1788684263.115660:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073199872 00000100:00100000:1.0:1788684263.115680:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:1.0:1788684263.115685:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2390:x1875571073200000:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684263.117015:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2390:x1875571073200000:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684263.117036:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:1.0:1788684263.117067:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:1.0:1788684263.117079:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073199872:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684263.117139:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2390:x1875571073199872:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 64us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684263.117146:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00080000:1.0:1788684263.118180:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788684263.118188:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788684263.118191:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684263.118193:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788684264.061615:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684264.573625:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085820800:0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.573690:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684264.573750:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085821312:0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.573776:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684264.573829:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085821824:0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.573851:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684264.573878:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788684264.573884:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085820928:0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.573906:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684264.573923:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085821440:0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.573945:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684264.573961:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085821952:0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.573978:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684264.574011:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085820800 00000100:00100000:2.0:1788684264.574018:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085820800 00000100:00100000:2.0:1788684264.574061:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788684264.574070:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085820800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.574120:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085820800:12345-0@lo:400:kworker.0 Request processed in 50us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684264.574128:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788684264.574151:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085821312 00000100:00100000:2.0:1788684264.574154:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085821312 00000100:00100000:2.0:1788684264.574186:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085821824 00000100:00100000:2.0:1788684264.574188:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085821824 00000100:00100000:2.0:1788684264.574203:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085820928 00000100:00100000:2.0:1788684264.574205:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085820928 00000100:00100000:2.0:1788684264.574221:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788684264.574227:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085821312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.574257:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085821312:12345-0@lo:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684264.574263:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788684264.574285:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788684264.574291:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085821824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.574320:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085821824:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684264.574326:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788684264.574337:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788684264.574343:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085820928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.574397:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085820928:12345-0@lo:400:kworker.0 Request processed in 55us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684264.574403:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788684264.574425:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085821440 00000100:00100000:2.0:1788684264.574428:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085821440 00000100:00100000:2.0:1788684264.574452:0:9991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085821952 00000100:00100000:2.0:1788684264.574454:0:9991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085821952 00000100:00100000:2.0:1788684264.574471:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788684264.574477:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085821440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.574520:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085821440:12345-0@lo:400:kworker.0 Request processed in 43us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684264.574526:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788684264.574538:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788684264.574544:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085821952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.574570:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085821952:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684264.574576:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788684264.574596:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684264.574601:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684264.574603:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684264.574651:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085820928:0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.574663:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085821440:0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.574672:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085821952:0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.574681:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085820800:0@lo:400:kworker.0 00010000:00080000:2.0:1788684264.574692:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6646d33100 x1875571085821312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684264.574702:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085821312:0@lo:400:kworker.0 00010000:00080000:2.0:1788684264.574713:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664876d180 x1875571085821824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684264.574722:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085821824:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.575698:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085820672:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.575747:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684264.575774:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085821184:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.575796:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684264.575813:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085821696:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.575833:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684264.575864:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788684264.575870:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085822208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684264.575895:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684264.575927:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085820544:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.575954:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684264.575973:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085821056:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.575996:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684264.576013:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085821568:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576032:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684264.576059:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085822080:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576081:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684264.576109:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085820544 00000100:00100000:0.0:1788684264.576114:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085820544 00000100:00100000:0.0:1788684264.576148:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788684264.576156:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085820544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576191:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085820544:12345-0@lo:400:kworker.0 Request processed in 36us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684264.576197:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788684264.576224:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085821056 00000100:00100000:0.0:1788684264.576228:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085821056 00000100:00100000:0.0:1788684264.576248:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788684264.576254:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085821056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576283:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085821056:12345-0@lo:400:kworker.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684264.576289:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788684264.576392:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085820544:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576406:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085821056:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576431:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085820672 00000100:00100000:0.0:1788684264.576434:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085820672 00000100:00100000:0.0:1788684264.576457:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085821184 00000100:00100000:0.0:1788684264.576459:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085821184 00000100:00100000:0.0:1788684264.576479:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085821696 00000100:00100000:0.0:1788684264.576482:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085821696 00000100:00100000:0.0:1788684264.576513:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788684264.576519:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085820672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576554:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085820672:12345-0@lo:400:kworker.0 Request processed in 34us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684264.576567:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788684264.576579:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788684264.576585:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085821184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576613:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085821184:12345-0@lo:400:kworker.0 Request processed in 28us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684264.576618:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788684264.576629:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788684264.576634:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085821696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576657:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085821696:12345-0@lo:400:kworker.0 Request processed in 24us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684264.576662:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788684264.576689:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085820672:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576697:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085821184:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576705:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085821696:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576735:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085821568 00000100:00100000:0.0:1788684264.576738:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085821568 00000100:00100000:0.0:1788684264.576763:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085822080 00000100:00100000:0.0:1788684264.576766:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085822080 00000100:00100000:0.0:1788684264.576782:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788684264.576788:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085821568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576821:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085821568:12345-0@lo:400:kworker.0 Request processed in 33us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684264.576827:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788684264.576838:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788684264.576850:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085822080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684264.576857:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085822208 00000100:00100000:2.0:1788684264.576861:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085822208 00000100:00100000:0.0:1788684264.576878:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085822080:12345-0@lo:400:kworker.0 Request processed in 29us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684264.576884:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788684264.576886:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788684264.576892:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085822208:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684264.576904:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788684264.576909:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00002000:00000024:2.0:1788684264.576913:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000004:00080000:0.0:1788684264.576924:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d664876d880, transno 4294967311 00000100:00100000:0.0:1788684264.576934:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085821568:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576943:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000100:00100000:2.0:1788684264.576945:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085822208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (1049us total) trans 0 rc 0/0 00000004:00080000:0.0:1788684264.576946:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788684264.576950:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788684264.576958:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085822080:0@lo:400:kworker.0 00000100:00100000:0.0:1788684264.576976:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085822208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788684264.577072:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684264.577076:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684264.577078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684264.578436:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684264.578451:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085822336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684264.578510:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684264.578549:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085822336 00000100:00100000:2.0:1788684264.578554:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085822336 00000100:00100000:2.0:1788684264.578589:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788684264.578607:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085822336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684264.578625:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788684264.578664:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085822336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684264.578670:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788684264.578711:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085822336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684265.085724:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684265.085745:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085822464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684265.085810:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684265.085867:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085822464 00000100:00100000:0.0:1788684265.085874:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085822464 00000100:00100000:0.0:1788684265.085913:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788684265.085921:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085822464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684265.085946:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788684265.085987:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085822464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684265.085994:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00010000:0.0:1788684265.089969:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684265.090042:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085822464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684265.090283:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085822592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684265.090343:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684265.090415:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085822592 00000100:00100000:1.0:1788684265.090422:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085822592 00000100:00100000:1.0:1788684265.090462:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788684265.090470:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085822592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684265.090511:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684265.090555:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085822592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684265.090561:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788684265.090605:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085822592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684265.090797:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085822720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684265.090825:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684265.091097:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085822720 00000100:00100000:0.0:1788684265.091102:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085822720 00000100:00100000:0.0:1788684265.091125:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788684265.091131:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677e70f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085822720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684265.091144:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788684265.091184:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677e70f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085822720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684265.091190:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788684265.091754:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085822720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684265.598142:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684265.598163:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085822848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684265.598224:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684265.598397:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085822848 00000100:00100000:2.0:1788684265.598404:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085822848 00000100:00100000:2.0:1788684265.598735:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788684265.598745:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085822848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684265.598775:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788684265.598835:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085822848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684265.598843:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788684265.598924:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085822848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684265.633166:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684265.633285:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073200384 00000100:00100000:0.0:1788684265.633295:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073200384 00000100:00100000:0.0:1788684265.633423:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 255 00000100:00100000:0.0:1788684265.633434:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:12149:x1875571073200384:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788684265.633566:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:12149:x1875571073200384:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 132us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684265.633574:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 255 00000100:00080000:2.0:1788684265.634053:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684265.640655:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684265.640734:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073200512 00000100:00100000:0.0:1788684265.640754:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073200512 00000100:00100000:0.0:1788684265.640830:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 256 00000100:00100000:0.0:1788684265.640840:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:12149:x1875571073200512:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788684265.640943:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:12149:x1875571073200512:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 104us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684265.640951:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 256 00000100:00080000:2.0:1788684265.641519:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684265.655392:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684265.655504:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073200768 00000100:00100000:2.0:1788684265.655514:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073200768 00000100:00100000:2.0:1788684265.655575:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:2.0:1788684265.655586:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:12149:x1875571073200768:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788684265.655828:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:12149:x1875571073200768:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 243us (485us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788684265.655836:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:3.0:1788684265.896823:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684265.897490:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073200896 00000100:00100000:0.0:1788684265.897500:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073200896 00000100:00100000:0.0:1788684265.897660:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 257 00000100:00100000:0.0:1788684265.897672:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:12952:x1875571073200896:12345-192.168.206.44@tcp:101:lsof.0 00010000:00010000:0.0:1788684265.897691:0:12443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684265.897711:0:12443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ad3d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3e19 expref: -99 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684265.897771:0:12443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad3d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684265.897786:0:12443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684265.897798:0:12443:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684265.897843:0:12443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788684265.897847:0:12443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684265.897867:0:12443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684265.897889:0:12443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891200/0x44bac02bd54ad3d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e19 expref: 7 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684265.897910:0:12443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e19 expref: 6 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684265.897920:0:12443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647580f00) 00010000:00010000:0.0:1788684265.897923:0:12443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684265.897926:0:12443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890000, rc 0) 00000100:00100000:0.0:1788684265.898040:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:12952:x1875571073200896:12345-192.168.206.44@tcp:101:lsof.0 Request processed in 371us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684265.898055:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 257 00000100:00080000:2.0:1788684265.898126:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788684266.109982:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684267.133695:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684268.163195:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788684268.164821:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1788684268.164854:0:6476:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788684268.165497:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788684268.165517:0:6529:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788684268.217572:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684268.217622:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684268.217659:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684268.217708:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684268.217733:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684268.217754:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684268.217774:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684268.217800:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073201536 00000100:00100000:1.0:1788684268.217808:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073201536 00000100:00100000:1.0:1788684268.217856:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073201408 00000100:00100000:1.0:1788684268.217859:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073201408 00000100:00100000:1.0:1788684268.217877:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:1.0:1788684268.217885:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677e51e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2391:x1875571073201536:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684268.218019:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677e51e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2391:x1875571073201536:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 134us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684268.218027:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:1.0:1788684268.218160:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:1.0:1788684268.218166:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073201408:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684268.218188:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073201408:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684268.218193:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00080000:1.0:1788684268.218208:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788684268.218211:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684268.218223:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073201280 00000100:00100000:1.0:1788684268.218226:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073201280 00000100:00100000:1.0:1788684268.218250:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073201792 00000100:00100000:1.0:1788684268.218252:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073201792 00000100:00100000:1.0:1788684268.218263:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073201152 00000100:00100000:1.0:1788684268.218265:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073201152 00000100:00100000:1.0:1788684268.218274:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073201664 00000100:00100000:1.0:1788684268.218276:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073201664 00000100:00100000:1.0:1788684268.218307:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 329 00000100:00100000:1.0:1788684268.218313:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073201280:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684268.218336:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2391:x1875571073201280:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684268.218343:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 329 00000100:00100000:1.0:1788684268.218351:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 330 00000100:00100000:1.0:1788684268.218356:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073201792:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684268.218768:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073201792:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 410us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684268.218776:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 330 00000100:00100000:1.0:1788684268.218788:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 331 00000100:00100000:1.0:1788684268.218794:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2391:x1875571073201152:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684268.218817:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:2391:x1875571073201152:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684268.218823:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 331 00000100:00100000:1.0:1788684268.218831:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 332 00000100:00100000:1.0:1788684268.218837:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073201664:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684268.218852:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073201664:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 16us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684268.218857:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 332 00000100:00080000:1.0:1788684268.218870:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684268.218873:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684268.219709:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073201024 00000100:00100000:2.0:1788684268.219718:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073201024 00000100:00100000:2.0:1788684268.219771:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 391 00000100:00100000:2.0:1788684268.219779:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073201024:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684268.219825:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6743f3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2391:x1875571073201024:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 47us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684268.219831:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 391 00010000:00010000:2.0:1788684269.181665:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788684269.423863:0:14984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:44:28 (1788684268) 00000100:00100000:0.0:1788684269.693810:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085822976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684269.693877:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684269.694163:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085823104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684269.694190:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684269.694273:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085822976 00000100:00100000:1.0:1788684269.694280:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085822976 00000100:00100000:1.0:1788684269.694355:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085823104 00000100:00100000:1.0:1788684269.694358:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085823104 00000100:00100000:1.0:1788684269.694408:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788684269.694416:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085822976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788684269.694442:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684269.694497:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085822976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684269.694505:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788684269.694520:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788684269.694527:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085823104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684269.694537:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684269.694560:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085823104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684269.694566:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788684269.694968:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085823232:0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.695001:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684269.695034:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085823744:0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.695056:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684269.695072:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085824256:0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.695091:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684269.695110:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788684269.695115:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085823616:0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.695135:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684269.695149:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085824128:0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.695166:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684269.695305:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085823744 00000100:00100000:3.0:1788684269.695310:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085823744 00000100:00080000:0.0:1788684269.695444:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684269.695467:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085823232 00000100:00100000:0.0:1788684269.695471:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085823232 00000100:00100000:0.0:1788684269.695499:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788684269.695505:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085823232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.695542:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085823232:12345-0@lo:400:kworker.0 Request processed in 37us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684269.695548:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788684269.695599:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085823104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684269.695623:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085823488:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.695647:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684269.695664:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085824000:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.695682:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684269.695699:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085824512:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.695718:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684269.695744:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085822976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684269.695755:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788684269.695760:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085823360:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.695787:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684269.695802:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085823872:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.695820:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684269.695835:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085824384:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.695851:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684269.695874:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085823488 00000100:00100000:0.0:1788684269.695878:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085823488 00000100:00100000:0.0:1788684269.695895:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788684269.695901:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085823744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.695930:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085823744:12345-0@lo:400:kworker.0 Request processed in 29us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684269.695935:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788684269.695947:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788684269.695952:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085823488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.695979:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085823488:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684269.695983:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788684269.695997:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085824256 00000100:00100000:0.0:1788684269.696000:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085824256 00000100:00100000:3.0:1788684269.696127:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085823616 00000100:00100000:3.0:1788684269.696132:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085823616 00000100:00100000:3.0:1788684269.696151:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085824128 00000100:00100000:3.0:1788684269.696153:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085824128 00000100:00100000:3.0:1788684269.696172:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788684269.696177:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085823616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.696207:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085823616:12345-0@lo:400:kworker.0 Request processed in 30us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684269.696213:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788684269.696223:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085824000 00000100:00100000:3.0:1788684269.696225:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085824000 00000100:00100000:3.0:1788684269.696238:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085823360 00000100:00100000:3.0:1788684269.696240:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085823360 00000100:00100000:3.0:1788684269.696249:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085823872 00000100:00100000:3.0:1788684269.696251:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085823872 00000100:00100000:3.0:1788684269.696262:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788684269.696267:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085824128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.696292:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085824128:12345-0@lo:400:kworker.0 Request processed in 25us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684269.696298:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788684269.696309:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788684269.696315:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085824000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.696340:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085824000:12345-0@lo:400:kworker.0 Request processed in 25us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684269.696345:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788684269.696354:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788684269.696359:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085823360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.696409:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085823360:12345-0@lo:400:kworker.0 Request processed in 50us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684269.696415:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788684269.696427:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788684269.696432:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085823872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684269.696453:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085823872:12345-0@lo:400:kworker.0 Request processed in 22us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684269.696468:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788684269.696563:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788684269.696570:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085824256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696600:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085824256:12345-0@lo:400:kworker.0 Request processed in 31us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684269.696605:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788684269.696621:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085824512 00000100:00100000:0.0:1788684269.696625:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085824512 00000100:00100000:0.0:1788684269.696656:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085824384 00000100:00100000:0.0:1788684269.696660:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085824384 00000100:00100000:0.0:1788684269.696681:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788684269.696687:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085824512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696714:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085824512:12345-0@lo:400:kworker.0 Request processed in 28us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684269.696720:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788684269.696732:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788684269.696737:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085824384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696760:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085824384:12345-0@lo:400:kworker.0 Request processed in 24us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684269.696766:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1788684269.696792:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684269.696796:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684269.696798:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684269.696820:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085823616:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696829:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085824128:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696837:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085823232:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696848:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085823744:0@lo:400:kworker.0 00010000:00080000:0.0:1788684269.696859:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648556300 x1875571085824256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684269.696868:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085824256:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696897:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085823360:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696906:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085823872:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696922:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085824384:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696930:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085823488:0@lo:400:kworker.0 00010000:00080000:0.0:1788684269.696938:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648665f80 x1875571085824000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684269.696946:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085824000:0@lo:400:kworker.0 00000100:00100000:0.0:1788684269.696954:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085824512:0@lo:400:kworker.0 00000040:00080000:1.0:1788684270.016539:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788684270.016550:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788684270.016664:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788684270.016674:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788684270.205644:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684270.210657:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085824640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684270.210730:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684270.210838:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684270.210844:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085824768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684270.210869:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684270.210902:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085824768 00000100:00100000:1.0:1788684270.210909:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085824768 00000100:00100000:1.0:1788684270.210948:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788684270.210956:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085824768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684270.210988:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788684270.211028:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085824768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684270.211035:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788684270.211077:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085824768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684270.211894:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085824896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684270.211934:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684270.212111:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085824640 00000100:00100000:2.0:1788684270.212117:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085824640 00000100:00100000:2.0:1788684270.212158:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788684270.212166:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67489c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085824640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684270.212190:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788684270.212226:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67489c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085824640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684270.212232:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788684270.212722:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085824640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684270.213207:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085824896 00000100:00100000:0.0:1788684270.213213:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085824896 00000100:00100000:0.0:1788684270.213283:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788684270.213291:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085824896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684270.213306:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788684270.213359:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085824896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684270.213385:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788684270.213473:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085824896:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788684270.526058:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788684270.717714:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085825024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684270.717789:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684270.717941:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085825024 00000100:00100000:3.0:1788684270.717950:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085825024 00000100:00100000:3.0:1788684270.718004:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788684270.718014:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085825024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684270.718045:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788684270.718100:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085825024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684270.718107:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788684270.718149:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085825024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788684271.230706:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684272.253666:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684272.582318:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684272.582393:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073202048 00000100:00100000:0.0:1788684272.582402:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073202048 00000100:00100000:0.0:1788684272.582484:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:0.0:1788684272.582495:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+18:13175:x1875571073202048:12345-192.168.206.44@tcp:35:umount.0 00000100:00080000:2.0:1788684272.582850:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684272.582886:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:13175:x1875571073202048:12345-192.168.206.44@tcp:35:umount.0 Request processed in 392us (576us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788684272.582907:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:2.0:1788684272.595030:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684272.595115:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073202304 00000100:00100000:3.0:1788684272.595124:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073202304 00000100:00100000:3.0:1788684272.595179:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:3.0:1788684272.595189:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+19:13175:x1875571073202304:12345-192.168.206.44@tcp:35:umount.0 00000100:00100000:3.0:1788684272.595504:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:13175:x1875571073202304:12345-192.168.206.44@tcp:35:umount.0 Request processed in 315us (483us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788684272.595513:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1788684272.606489:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684272.606570:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073202560 00000100:00100000:3.0:1788684272.606583:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073202560 00000100:00100000:3.0:1788684272.606659:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:3.0:1788684272.606669:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6749553050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+20:13175:x1875571073202560:12345-192.168.206.44@tcp:35:umount.0 00000100:00100000:3.0:1788684272.607188:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6749553050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:13175:x1875571073202560:12345-192.168.206.44@tcp:35:umount.0 Request processed in 518us (705us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788684272.607198:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:1.0:1788684272.614613:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684272.614694:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073202816 00000100:00100000:0.0:1788684272.614714:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073202816 00000100:00100000:0.0:1788684272.614776:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:0.0:1788684272.614785:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:13175:x1875571073202816:12345-192.168.206.44@tcp:35:umount.0 00000100:00100000:0.0:1788684272.615087:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:13175:x1875571073202816:12345-192.168.206.44@tcp:35:umount.0 Request processed in 302us (485us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788684272.615096:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:2.0:1788684272.624534:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684272.624624:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073202944 00000100:00100000:3.0:1788684272.624634:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073202944 00000100:00100000:3.0:1788684272.624697:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:3.0:1788684272.624707:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2390:x1875571073202944:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684272.624724:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684272.624745:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477ff800/0x44bac02bd54ac2f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed392d expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684272.624763:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684272.624820:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:922b1c50-9c41-4b31-aa18-fe2699f20279+12:2390:x1875571073202944:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 115us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684272.624840:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1788684272.637885:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684272.637920:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684272.638017:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684272.638219:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073203456 00000100:00100000:0.0:1788684272.638228:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073203456 00000100:00100000:0.0:1788684272.638292:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:0.0:1788684272.638303:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+7:2389:x1875571073203456:12345-192.168.206.44@tcp:9:umount.0 00000020:00000080:0.0:1788684272.638338:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac942 00000020:00010000:0.0:1788684272.638346:0:8411:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d677fbf8000: total 0 00000100:00080000:0.0:1788684272.638350:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8d677fbfe000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684272.638419:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788684272.638594:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2389:x1875571073203456:12345-192.168.206.44@tcp:9:umount.0 Request processed in 291us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684272.638602:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 81 00000020:00010000:0.0:1788684272.638627:0:6485:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d677fbf8000: total 0 00010000:00010000:0.0:1788684272.638659:0:6485:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d677fbf8000, canceled 0 locks, left on hash table 2. 00000100:00100000:2.0:1788684272.638808:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073203584 00000100:00100000:2.0:1788684272.638814:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073203584 00000100:00100000:2.0:1788684272.638852:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073203072 00000100:00100000:2.0:1788684272.638868:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073203072 00000100:00100000:2.0:1788684272.638894:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:2.0:1788684272.638902:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:922b1c50-9c41-4b31-aa18-fe2699f20279+13:2392:x1875571073203584:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684272.638912:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684272.638930:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711dc00/0x44bac02bd54ac3ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed396c expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.638948:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684272.638971:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:922b1c50-9c41-4b31-aa18-fe2699f20279+12:2392:x1875571073203584:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 70us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684272.638978:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:2.0:1788684272.638993:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1788684272.639000:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:922b1c50-9c41-4b31-aa18-fe2699f20279+11:2390:x1875571073203072:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684272.639007:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684272.639017:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711ce00/0x44bac02bd54ac601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a45 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.639027:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684272.639044:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2390:x1875571073203072:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 46us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684272.639050:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00010000:00010000:0.0:1788684272.639402:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f52e6150/0x44bac02bd54accfa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c2f expref: 4 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684272.639436:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3d247ac/0x44bac02bd54ad3c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e12 expref: 3 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684272.639472:0:6485:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d677fbf8000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788684272.639497:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684272.639499:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684272.639501:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788684272.639535:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684272.655472:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684272.655559:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073203712 00000100:00100000:0.0:1788684272.655569:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073203712 00000100:00100000:0.0:1788684272.655649:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:0.0:1788684272.655660:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2389:x1875571073203712:12345-192.168.206.44@tcp:9:umount.0 00000020:00000080:0.0:1788684272.655698:0:8413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac6cc 00000100:00080000:0.0:1788684272.655707:0:8413:0:(import.c:65:import_set_state_nolock()) ffff8d6647914000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684272.655753:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788684272.655919:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+2:2389:x1875571073203712:12345-192.168.206.44@tcp:9:umount.0 Request processed in 260us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684272.655927:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00080000:2.0:1788684272.656046:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788684272.656216:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684272.668217:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684272.668294:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073204736 00000100:00100000:3.0:1788684272.668302:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073204736 00000100:00100000:3.0:1788684272.668359:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 258 00000100:00100000:3.0:1788684272.668400:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+22:2389:x1875571073204736:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:3.0:1788684272.668429:0:13784:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac2ff 00000020:00010000:3.0:1788684272.668453:0:13784:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d6646d44000: total 0 00000100:00080000:3.0:1788684272.668458:0:13784:0:(import.c:65:import_set_state_nolock()) ffff8d6646d42000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684272.668486:0:13784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1788684272.668611:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+21:2389:x1875571073204736:12345-192.168.206.44@tcp:39:umount.0 Request processed in 243us (402us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788684272.668631:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 258 00000020:00010000:2.0:1788684272.668725:0:9499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d6646d44000: total 0 00010000:00010000:2.0:1788684272.668778:0:9499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d6646d44000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788684272.668815:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684272.668819:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684272.668826:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ad38a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dfd expref: 20 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.668851:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684272.668854:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684272.668858:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54acbdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3be2 expref: 19 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.668870:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d677cc3c700) 00010000:00010000:2.0:1788684272.668873:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684272.668876:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711c800/0x44bac02bd54ac62b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a53 expref: 18 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.668892:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647580f00) 00010000:00010000:2.0:1788684272.668894:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684272.668897:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54acd63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c4b expref: 17 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.668912:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684272.668914:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788684272.668918:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad3b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e0b expref: 16 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.668929:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684272.668931:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788684272.668935:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d200/0x44bac02bd54ac6a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a6f expref: 15 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.668945:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684272.668947:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684272.668955:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1200/0x44bac02bd54accbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c1a expref: 14 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.668972:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684272.668974:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788684272.668978:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ad06c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3d2b expref: 13 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.668988:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8d6750bd9100) 00010000:00010000:2.0:1788684272.668990:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788684272.668993:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0200/0x44bac02bd54ac99d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3b48 expref: 12 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.669006:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d675677d200) 00010000:00010000:2.0:1788684272.669009:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684272.669013:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0a00/0x44bac02bd54ac647 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a5a expref: 11 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.669025:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8d6647580600) 00010000:00010000:2.0:1788684272.669027:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684272.669030:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d677711d400/0x44bac02bd54ad2aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3dc5 expref: 10 pid: 7963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.669042:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8d6641869100) 00010000:00010000:2.0:1788684272.669044:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788684272.669048:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1a00/0x44bac02bd54acce5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c28 expref: 9 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.669070:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8d6641867000) 00010000:00010000:2.0:1788684272.669076:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788684272.669080:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54acd7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3c52 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684272.669093:0:9499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d6646d44000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788684272.669105:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684272.669108:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684272.669109:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684272.680091:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684272.680276:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073204864 00000100:00100000:0.0:1788684272.680285:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073204864 00000100:00100000:0.0:1788684272.680351:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 259 00000100:00100000:0.0:1788684272.680362:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+5:2389:x1875571073204864:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:0.0:1788684272.680420:0:6498:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac306 00000100:00080000:0.0:1788684272.680434:0:6498:0:(import.c:65:import_set_state_nolock()) ffff8d677e50a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684272.680465:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788684272.680612:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0eb7f700-7065-4a98-9ec9-c4bbe6317e8e+3:2389:x1875571073204864:12345-192.168.206.44@tcp:39:umount.0 Request processed in 250us (533us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788684272.680634:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 259 00010000:00010000:3.0:1788684272.680823:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788684272.681187:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788684273.277839:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684273.338630:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684273.338685:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684273.338720:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684273.338811:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073205120 00000100:00100000:2.0:1788684273.338822:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073205120 00000100:00100000:2.0:1788684273.338894:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073205248 00000100:00100000:2.0:1788684273.338897:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073205248 00000100:00100000:2.0:1788684273.338922:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 339 00000100:00100000:2.0:1788684273.338932:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073205120:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684273.339001:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2391:x1875571073205120:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 70us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684273.339009:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 339 00000100:00100000:2.0:1788684273.339026:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 340 00000100:00100000:2.0:1788684273.339033:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073205248:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684273.339059:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2391:x1875571073205248:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684273.339065:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 340 00000100:00080000:0.0:1788684273.339268:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684273.339273:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684273.339553:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073204992 00000100:00100000:1.0:1788684273.339558:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073204992 00000100:00100000:1.0:1788684273.339598:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 393 00000100:00100000:1.0:1788684273.339605:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2391:x1875571073204992:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684273.339653:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2391:x1875571073204992:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 48us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684273.339660:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 393 00000100:00100000:0.0:1788684274.266875:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684274.266927:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684274.266979:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684274.267426:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073205376 00000100:00100000:3.0:1788684274.267446:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073205376 00000100:00100000:3.0:1788684274.267516:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073205632 00000100:00100000:3.0:1788684274.267520:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073205632 00000100:00100000:0.0:1788684274.267685:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073205504 00000100:00100000:0.0:1788684274.267690:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073205504 00000100:00100000:0.0:1788684274.267717:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:0.0:1788684274.267726:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:922b1c50-9c41-4b31-aa18-fe2699f20279+12:2391:x1875571073205376:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684274.267739:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684274.267758:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d676d810e00/0x44bac02bd54ac402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3981 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684274.267777:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684274.267825:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:922b1c50-9c41-4b31-aa18-fe2699f20279+11:2391:x1875571073205376:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 100us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.267832:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:0.0:1788684274.267848:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:0.0:1788684274.267855:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:922b1c50-9c41-4b31-aa18-fe2699f20279+10:2391:x1875571073205632:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684274.267863:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684274.267872:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ac5fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3a3e expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684274.267897:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684274.267914:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:922b1c50-9c41-4b31-aa18-fe2699f20279+9:2391:x1875571073205632:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 59us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.267921:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:0.0:1788684274.267932:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:0.0:1788684274.267938:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:922b1c50-9c41-4b31-aa18-fe2699f20279+8:2391:x1875571073205504:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684274.267945:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684274.268035:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477fe600/0x44bac02bd54ac409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed39b2 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684274.268044:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684274.268062:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:922b1c50-9c41-4b31-aa18-fe2699f20279+7:2391:x1875571073205504:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 124us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.268068:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:2.0:1788684274.269694:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684274.269934:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073205888 00000100:00100000:0.0:1788684274.269942:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073205888 00000100:00100000:0.0:1788684274.270001:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 260 00000100:00100000:0.0:1788684274.270011:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+6:2389:x1875571073205888:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:0.0:1788684274.270045:0:6498:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac417 00000020:00010000:0.0:1788684274.270054:0:6498:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d664798b000: total 0 00000100:00080000:0.0:1788684274.270058:0:6498:0:(import.c:65:import_set_state_nolock()) ffff8d664798e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684274.270816:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00010000:2.0:1788684274.270869:0:9499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d664798b000: total 0 00010000:00010000:2.0:1788684274.270874:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684274.270920:0:9499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d664798b000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788684274.270961:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6647580f00) 00010000:00010000:2.0:1788684274.270977:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684274.270987:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ad3d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e19 expref: 5 pid: 12443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684274.271010:0:9499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d664798b000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788684274.271023:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684274.271023:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be304e4e-7c60-433e-98d3-9fc97bdb0b28+4:2389:x1875571073205888:12345-192.168.206.44@tcp:39:umount.0 Request processed in 1013us (1335us total) trans 4294967529 rc 0/0 00010000:00010000:2.0:1788684274.271025:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684274.271027:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684274.271031:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 260 00000100:00100000:2.0:1788684274.277929:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684274.278054:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073206016 00000100:00100000:0.0:1788684274.278066:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073206016 00000100:00100000:0.0:1788684274.278447:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 261 00000100:00100000:0.0:1788684274.278460:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+5:2389:x1875571073206016:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:0.0:1788684274.278515:0:12443:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac41e 00000100:00080000:0.0:1788684274.278592:0:12443:0:(import.c:65:import_set_state_nolock()) ffff8d664798d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684274.278676:0:12443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788684274.278898:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:be304e4e-7c60-433e-98d3-9fc97bdb0b28+3:2389:x1875571073206016:12345-192.168.206.44@tcp:39:umount.0 Request processed in 440us (983us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788684274.278907:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 261 00010000:00010000:3.0:1788684274.279059:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684274.301323:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684274.301561:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073206272 00000100:00100000:0.0:1788684274.301575:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073206272 00000100:00100000:0.0:1788684274.301639:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 394 00000100:00100000:0.0:1788684274.301651:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+7:2389:x1875571073206272:12345-192.168.206.44@tcp:251:umount.0 00000020:00000080:0.0:1788684274.301704:0:6491:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac2dc 00000020:00010000:0.0:1788684274.301720:0:6491:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d677fa98800: total 0 00000100:00080000:0.0:1788684274.301726:0:6491:0:(import.c:65:import_set_state_nolock()) ffff8d677fa9e000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788684274.301806:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:922b1c50-9c41-4b31-aa18-fe2699f20279+3:2389:x1875571073206272:12345-192.168.206.44@tcp:251:umount.0 Request processed in 158us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.301814:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 394 00000020:00010000:3.0:1788684274.302171:0:6486:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d677fa98800: total 0 00010000:00010000:3.0:1788684274.302239:0:6486:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d677fa98800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788684274.302763:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54ac3b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3973 expref: 2 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684274.302782:0:6486:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d677fa98800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788684274.302797:0:6486:0:(genops.c:885:class_export_put()) final put ffff8d677fa98800/922b1c50-9c41-4b31-aa18-fe2699f20279 00010000:00010000:3.0:1788684274.302817:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684274.302820:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684274.302822:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684274.302904:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788684274.303090:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fa98800/922b1c50-9c41-4b31-aa18-fe2699f20279 for MGS 00000020:00000080:1.0:1788684274.303149:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677fa9e000 for MGS 00000100:00100000:3.0:1788684274.813693:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085825536:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.813760:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684274.813811:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085826048:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.813835:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684274.813867:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085826560:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.813888:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684274.813909:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788684274.813915:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085825408:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.813937:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684274.814095:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085825152:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814131:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684274.814157:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085825664:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814183:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085825280:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814207:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684274.814228:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085825792:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814259:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684274.814279:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085826304:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814299:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684274.814335:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085826048 00000100:00100000:0.0:1788684274.814342:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085826048 00000100:00100000:0.0:1788684274.814417:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085826560 00000100:00100000:0.0:1788684274.814421:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085826560 00000100:00100000:0.0:1788684274.814457:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788684274.814466:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085826048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814511:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085826048:12345-0@lo:400:kworker.0 Request processed in 46us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.814518:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788684274.814534:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788684274.814541:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085826560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814570:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085826560:12345-0@lo:400:kworker.0 Request processed in 29us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.814576:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788684274.814597:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085825152 00000100:00100000:0.0:1788684274.814601:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085825152 00000100:00100000:0.0:1788684274.814625:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788684274.814631:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085825152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814664:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3623:x1875571085825152:12345-0@lo:400:kworker.0 Request processed in 34us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.814671:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788684274.814700:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085825536 00000100:00100000:0.0:1788684274.814703:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085825536 00000100:00100000:0.0:1788684274.814728:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085825280 00000100:00100000:0.0:1788684274.814736:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085825280 00000100:00100000:0.0:1788684274.814756:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085825792 00000100:00100000:0.0:1788684274.814758:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085825792 00000100:00100000:0.0:1788684274.814772:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085826304 00000100:00100000:0.0:1788684274.814774:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085826304 00000100:00100000:0.0:1788684274.814789:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788684274.814795:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085825536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814826:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085825536:12345-0@lo:400:kworker.0 Request processed in 32us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.814833:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788684274.814857:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788684274.814863:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085825280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814895:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085825280:12345-0@lo:400:kworker.0 Request processed in 32us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.814900:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788684274.814912:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788684274.814917:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085825792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.814943:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085825792:12345-0@lo:400:kworker.0 Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.815086:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788684274.815101:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788684274.815108:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085826304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.815139:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085826304:12345-0@lo:400:kworker.0 Request processed in 32us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.815144:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:0.0:1788684274.815168:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684274.815173:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684274.815181:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684274.815249:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085826944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684274.815277:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684274.815309:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085826944 00000100:00100000:0.0:1788684274.815313:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085826944 00000100:00100000:0.0:1788684274.815338:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788684274.815345:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085826944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684274.815387:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684274.815424:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085826944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.815430:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788684274.815485:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085826944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684274.815513:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085826816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684274.815535:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684274.815562:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085825280:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.815574:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085825792:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.815585:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085826304:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.815609:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085826816 00000100:00100000:0.0:1788684274.815612:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085826816 00000100:00100000:0.0:1788684274.815638:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788684274.815644:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085826816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788684274.815654:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788684274.815683:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085826816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.815689:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1788684274.815710:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684274.815733:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085826816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684274.816263:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085825920:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816291:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684274.816310:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085826432:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816330:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684274.816355:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085825536:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816388:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085826048:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816400:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085826560:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816428:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085825920 00000100:00100000:3.0:1788684274.816443:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085825920 00000100:00100000:3.0:1788684274.816478:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085826432 00000100:00100000:3.0:1788684274.816481:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085826432 00000100:00100000:3.0:1788684274.816500:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788684274.816506:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085825920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816545:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085825920:12345-0@lo:400:kworker.0 Request processed in 39us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684274.816551:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788684274.816564:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788684274.816570:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085826432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816597:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085826432:12345-0@lo:400:kworker.0 Request processed in 27us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684274.816602:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:3.0:1788684274.816623:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684274.816632:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684274.816654:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085826176:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816677:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684274.816707:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085826688:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816728:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684274.816756:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085825152:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816777:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085826176 00000100:00100000:3.0:1788684274.816780:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085826176 00000100:00100000:3.0:1788684274.816801:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085826688 00000100:00100000:3.0:1788684274.816804:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085826688 00000100:00100000:3.0:1788684274.816825:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788684274.816831:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085826176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.816932:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085826176:12345-0@lo:400:kworker.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684274.816938:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788684274.817065:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788684274.817073:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085826688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.817105:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085826688:12345-0@lo:400:kworker.0 Request processed in 34us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684274.817111:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1788684274.817132:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684274.817152:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085826176:0@lo:400:kworker.0 00000100:00100000:3.0:1788684274.817162:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085826688:0@lo:400:kworker.0 00010000:00080000:3.0:1788684274.817192:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648554700 x1875571085825920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684274.817202:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085825920:0@lo:400:kworker.0 00010000:00080000:3.0:1788684274.817211:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648554380 x1875571085826432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684274.817234:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085826432:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.819161:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085825408 00000100:00100000:0.0:1788684274.819175:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085825408 00000100:00100000:0.0:1788684274.819216:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085825664 00000100:00100000:0.0:1788684274.819220:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085825664 00000100:00100000:0.0:1788684274.819238:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788684274.819247:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085825408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.819331:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085825408:12345-0@lo:400:kworker.0 Request processed in 84us (5391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.819337:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788684274.819354:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788684274.819360:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085825664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.819415:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085825664:12345-0@lo:400:kworker.0 Request processed in 54us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684274.819421:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788684274.819491:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085825664:0@lo:400:kworker.0 00000100:00100000:0.0:1788684274.819524:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085825408:0@lo:400:kworker.0 00000100:00100000:2.0:1788684275.325707:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085827072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684275.325779:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684275.326940:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684275.327000:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085827200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684275.327046:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684275.327075:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684275.327082:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085827328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684275.327108:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684275.327141:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085827200 00000100:00100000:1.0:1788684275.327147:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085827200 00000100:00100000:1.0:1788684275.327193:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788684275.327203:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085827200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684275.327234:0:6503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788684275.327275:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085827200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684275.327282:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788684275.327303:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085827072 00000100:00100000:1.0:1788684275.327306:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085827072 00000100:00100000:1.0:1788684275.327325:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085827328 00000100:00100000:1.0:1788684275.327328:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085827328 00000100:00100000:1.0:1788684275.327338:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788684275.327344:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085827072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684275.327361:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788684275.332490:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085827200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684275.337283:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085827072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9930us (11496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684275.337297:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788684275.337353:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788684275.337381:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085827328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684275.337405:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788684275.337485:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085827328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (10376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684275.337492:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788684275.337601:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085827328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684275.347000:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085827072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684275.838093:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085827456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684275.838340:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684275.838479:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085827456 00000100:00100000:0.0:1788684275.838488:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085827456 00000100:00100000:0.0:1788684275.838537:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788684275.838558:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085827456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684275.838604:0:9159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788684275.838648:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085827456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684275.838654:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788684275.838712:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085827456:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788684275.847125:0:6476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000001:00080000:3.0:1788684275.847142:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:3.0:1788684275.847149:0:6476:0:(genops.c:885:class_export_put()) final put ffff8d664798b000/be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000001:00100000:3.0:1788684275.847169:0:6476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000001:00080000:3.0:1788684275.847175:0:6476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788684275.847182:0:6476:0:(genops.c:885:class_export_put()) final put ffff8d6646d44000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:2.0:1788684275.847527:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664798b000/be304e4e-7c60-433e-98d3-9fc97bdb0b28 for lustre-MDT0000 00000020:00000080:2.0:1788684275.847606:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646d44000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e for lustre-MDT0000 00000020:00000080:2.0:1788684275.847637:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664798e800 for lustre-MDT0000 00000020:00000080:2.0:1788684275.847643:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6646d42000 for lustre-MDT0000 00000020:01000004:3.0:1788684275.971172:0:15181:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788684275.981555:0:15181:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788684275.981638:0:15181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.981663:0:15181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.981673:0:15181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.981681:0:15181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.981922:0:15181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788684275.981929:0:15181:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788684275.981963:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788684275.981968:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788684275.981976:0:15181:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788684275.982006:0:15181:0:(import.c:65:import_set_state_nolock()) ffff8d6775f82000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788684275.982074:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085827584:0@lo:39:umount.0 00000100:00100000:3.0:1788684275.982172:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684275.982220:0:12443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085827584 00000100:00100000:0.0:1788684275.982232:0:12443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085827584 00000100:00100000:0.0:1788684275.985303:0:12443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788684275.985327:0:12443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875571085827584:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788684275.985361:0:12443:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abef3 00000100:00080000:0.0:1788684275.985384:0:12443:0:(import.c:65:import_set_state_nolock()) ffff8d6751b70000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788684275.988243:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788684275.988439:0:12443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3622:x1875571085827584:12345-0@lo:39:umount.0 Request processed in 3107us (6250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684275.988452:0:12443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1788684275.988473:0:12443:0:(genops.c:885:class_export_put()) final put ffff8d675dd6c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788684275.988517:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d675dd6c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788684275.988582:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6751b70000 for lustre-MDT0000 00000100:00080000:0.0:1788684275.988647:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775f82000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788684275.988661:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085827584:0@lo:39:umount.0 00010000:00010000:3.0:1788684275.995060:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788684275.995110:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788684275.995115:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788684275.995125:0:15181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788684275.996154:0:15181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996176:0:15181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996184:0:15181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996192:0:15181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996235:0:15181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684275.996242:0:15181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996248:0:15181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996253:0:15181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996259:0:15181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996294:0:15181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788684275.996315:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684275.996321:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996329:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477fe400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684275.996332:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996342:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684275.996350:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684275.996357:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788684275.996359:0:9499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788684275.996447:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996454:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684275.996490:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996498:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477fe400/0x44bac02bd54ac392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac399 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996518:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684275.996521:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996534:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67820ef200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684275.996537:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996544:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684275.996551:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684275.996557:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788684275.996559:0:9499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788684275.996561:0:9499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788684275.996578:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684275.996584:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684275.997570:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684275.997587:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684275.997600:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684275.997610:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684275.997635:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684275.997641:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788684275.997643:0:6486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788684275.997645:0:6486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1788684275.997688:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085827712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684275.997780:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684275.998003:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085827712 00000100:00100000:2.0:1788684275.998013:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085827712 00000100:00100000:2.0:1788684275.998081:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684275.998093:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3626:x1875571085827712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684275.998109:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684275.998127:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a1000/0x44bac02bd54ac399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac392 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684275.998145:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684275.998186:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3626:x1875571085827712:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684275.998193:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684275.998240:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085827712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684275.998301:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684275.998309:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684275.998507:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.000721:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.000744:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67820ef200/0x44bac02bd54ac296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac29d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.000767:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.000769:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.000772:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.000793:0:15181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.000803:0:15181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.000823:0:15181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.000830:0:15181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684276.000983:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684276.001001:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66479a1400/0x44bac02bd54ac384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac38b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684276.001034:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085827968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684276.001123:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684276.001185:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684276.001192:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085827840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684276.001215:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684276.001252:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085827968 00000100:00100000:2.0:1788684276.001262:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085827968 00000100:00100000:2.0:1788684276.001315:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085827840 00000100:00100000:2.0:1788684276.001318:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085827840 00000100:00100000:2.0:1788684276.001340:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684276.001349:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+24:3624:x1875571085827968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684276.001382:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684276.001403:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477ffa00/0x44bac02bd54ac38b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac384 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684276.001417:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684276.001466:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+23:3624:x1875571085827968:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684276.001473:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684276.001491:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684276.001498:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+22:3624:x1875571085827840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684276.001506:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684276.001516:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67560a7400/0x44bac02bd54ac29d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac296 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684276.001532:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684276.001570:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3624:x1875571085827840:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684276.001577:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788684276.002700:0:15181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684276.002719:0:15181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.002732:0:15181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.002739:0:15181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.002747:0:15181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.002768:0:15181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788684276.002774:0:15181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788684276.002781:0:15181:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788684276.002831:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684276.002839:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.002848:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684276.002851:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.002874:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684276.002882:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684276.002888:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788684276.002892:0:9499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788684276.002894:0:9499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788684276.002932:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.002939:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788684276.003304:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085828096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684276.003393:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684276.003473:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085828096 00000100:00100000:0.0:1788684276.003481:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085828096 00000100:00100000:0.0:1788684276.003525:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788684276.003534:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+21:3625:x1875571085828096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684276.003559:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684276.003575:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a1c00/0x44bac02bd54ac5f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac5ec expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684276.003605:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684276.003645:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:3625:x1875571085828096:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684276.003652:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788684276.003698:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085828096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684276.004335:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684276.004345:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684276.004354:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67820eec00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684276.004357:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684276.004380:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684276.004389:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684276.004395:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788684276.004398:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788684276.004401:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788684276.004439:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684276.004446:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684276.004571:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684276.004579:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647891400/0x44bac02bd54ac5ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac5f3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684276.004657:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684276.004682:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67820eec00/0x44bac02bd54abe52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54abe59 expref: -99 pid: 6474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684276.004694:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684276.004695:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684276.004697:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.004930:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.004932:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.004934:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788684276.004954:0:15181:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788684276.004959:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788684276.004965:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684276.004972:0:15181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:3.0:1788684276.004979:0:15181:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d664740e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788684276.004985:0:15181:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d6645995800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788684276.004990:0:15181:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d677e121800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788684276.005000:0:15181:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d677cc88800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788684276.005006:0:15181:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8d67482e0000) has exports, disconnecting them 00000020:00080000:3.0:1788684276.005011:0:15181:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d664740e800), last request at 1788684274 00000020:00000080:3.0:1788684276.005019:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac203 00000100:00080000:3.0:1788684276.005040:0:15181:0:(import.c:65:import_set_state_nolock()) ffff8d6647408000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788684276.005098:0:15181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d664740e800): rc 0 00000020:00000080:3.0:1788684276.005100:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d664740e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788684276.005114:0:15181:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d6645995800), last request at 1788684274 00000020:00000080:3.0:1788684276.005118:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac0e4 00000100:00080000:3.0:1788684276.005124:0:15181:0:(import.c:65:import_set_state_nolock()) ffff8d6645991800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788684276.005136:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788684276.005143:0:15181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6645995800): rc 0 00000020:00000080:3.0:1788684276.005145:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6645995800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788684276.005149:0:15181:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d677e121800), last request at 1788684060 00000020:00000080:3.0:1788684276.005152:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abfda 00000100:00080000:3.0:1788684276.005156:0:15181:0:(import.c:65:import_set_state_nolock()) ffff8d677e121000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788684276.005165:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788684276.005172:0:15181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d677e121800): rc 0 00000020:00000080:3.0:1788684276.005174:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d677e121800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788684276.005179:0:15181:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d677cc88800), last request at 1788684060 00000020:00000080:3.0:1788684276.005183:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abf9b 00000100:00080000:3.0:1788684276.005187:0:15181:0:(import.c:65:import_set_state_nolock()) ffff8d6775f85800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788684276.005196:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788684276.005203:0:15181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:3.0:1788684276.005316:0:15181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d677cc88800): rc 0 00000004:00000080:3.0:1788684276.005324:0:15181:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb81ec1557ae0 00000100:00080000:3.0:1788684276.005348:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788684276.005353:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1788684276.006256:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684276.007053:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684276.007084:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085828224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684276.007182:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788684276.008335:0:15181:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788684276.008403:0:15181:0:(import.c:65:import_set_state_nolock()) ffff8d677cc8f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788684276.008695:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085828224 00000100:00100000:2.0:1788684276.008706:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085828224 00000100:00100000:2.0:1788684276.008766:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788684276.008777:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+20:3625:x1875571085828224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684276.008792:0:9510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684276.008815:0:9510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740031200/0x44bac02bd54abe59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54abe52 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684276.009700:0:9510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684276.009800:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:3625:x1875571085828224:12345-0@lo:103:ldlm_bl.0 Request processed in 1023us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684276.009811:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788684276.010061:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788684276.010066:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788684276.010084:0:15181:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788684276.010145:0:15181:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788684276.010175:0:15181:0:(import.c:65:import_set_state_nolock()) ffff8d677cefb000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788684276.010186:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788684276.010189:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1788684276.010201:0:15181:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788684276.010261:0:15181:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788684276.010271:0:15181:0:(import.c:65:import_set_state_nolock()) ffff8d664773d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788684276.010303:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d67482e0000) has no exports 00010000:00010000:3.0:1788684276.010420:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.010436:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.010439:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684276.010495:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085827840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684276.010509:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085827968:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788684276.010551:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664740e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1788684276.010721:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3625:1875571085828224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684276.011350:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085828352:0@lo:39:umount.0 00000100:00100000:0.0:1788684276.011457:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684276.011500:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085828480:0@lo:9:umount.0 00000100:00100000:0.0:1788684276.011527:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684276.011549:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085828608:0@lo:9:umount.0 00000100:00100000:0.0:1788684276.011572:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684276.011679:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085828480 00000100:00100000:0.0:1788684276.011687:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085828480 00000100:00100000:0.0:1788684276.011744:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085828608 00000100:00100000:0.0:1788684276.011747:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085828608 00000100:00100000:0.0:1788684276.011778:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788684276.011789:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875571085828480:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788684276.011819:0:8412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac193 00000100:00100000:2.0:1788684276.011942:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085828352 00000100:00100000:2.0:1788684276.011947:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085828352 00000100:00100000:2.0:1788684276.011980:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788684276.011986:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875571085828352:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788684276.012005:0:6502:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac04a 00000100:00080000:2.0:1788684276.012014:0:6502:0:(import.c:65:import_set_state_nolock()) ffff8d677dfd0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788684276.012044:0:6502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788684276.012217:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3622:x1875571085828352:12345-0@lo:39:umount.0 Request processed in 229us (759us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788684276.012245:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00010000:2.0:1788684276.012273:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788684276.012305:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc8f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788684276.012315:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085828352:0@lo:39:umount.0 00000020:00000080:3.0:1788684276.012760:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6645995800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788684276.012817:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677e121800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788684276.012838:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6647408000 for lustre-MDT0000 00000020:00000080:3.0:1788684276.012843:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6645991800 for lustre-MDT0000 00000020:00000080:3.0:1788684276.012848:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677e121000 for lustre-MDT0000 00000100:00080000:0.0:1788684276.012911:0:8412:0:(import.c:65:import_set_state_nolock()) ffff8d6645997000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684276.012964:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788684276.013106:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3622:x1875571085828480:12345-0@lo:9:umount.0 Request processed in 1318us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684276.013129:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788684276.013151:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788684276.013160:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875571085828608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788684276.013180:0:8412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac2c7 00000100:00080000:0.0:1788684276.013187:0:8412:0:(import.c:65:import_set_state_nolock()) ffff8d677fa98000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684276.013215:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788684276.013287:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3622:x1875571085828608:12345-0@lo:9:umount.0 Request processed in 128us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684276.013293:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788684276.013316:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684276.013320:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788684276.013336:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684276.014487:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788684276.014665:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cefb000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788684276.014687:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788684276.014690:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788684276.014695:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085828480:0@lo:9:umount.0 00000100:00080000:2.0:1788684276.014715:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664773d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788684276.014726:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788684276.014728:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788684276.014730:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085828608:0@lo:9:umount.0 00000020:00080000:2.0:1788684276.028022:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d67482e0000) has no exports 00000020:00000080:2.0:1788684276.068682:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abead 00000020:00000080:2.0:1788684276.068698:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6775ee2000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788684276.068712:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788684276.068922:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775ee2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788684276.068951:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684276.068961:0:15181:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788684276.068965:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8d6748254d40) has no exports 00000020:00000080:0.0:1788684276.069343:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abea6 00000020:00000080:0.0:1788684276.069355:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6775e83000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788684276.069480:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684276.069502:0:15181:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788684276.069505:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6775e81800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788684276.069508:0:15181:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775e81800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788684276.069515:0:15181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788684276.069538:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775e83000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788684276.349908:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684277.379441:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788684277.894970:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788684277.894989:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788684277.894996:0:7428:0:(genops.c:885:class_export_put()) final put ffff8d6775f81000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788684277.895216:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000001:00080000:2.0:1788684277.895224:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788684277.895227:0:7428:0:(genops.c:885:class_export_put()) final put ffff8d664798c800/be304e4e-7c60-433e-98d3-9fc97bdb0b28 00000001:00100000:1.0:1788684277.895948:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788684277.895957:0:9488:0:(genops.c:885:class_export_put()) final put ffff8d677fa9a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788684277.896059:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788684277.896064:0:8406:0:(genops.c:885:class_export_put()) final put ffff8d6645994800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788684277.897111:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775f81000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:2.0:1788684277.897924:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000001:00080000:2.0:1788684277.897936:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788684277.897943:0:7428:0:(genops.c:885:class_export_put()) final put ffff8d6748214000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:0.0:1788684277.898127:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664798c800/be304e4e-7c60-433e-98d3-9fc97bdb0b28 for lustre-MDT0001 00000020:00000080:0.0:1788684277.898168:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677dfd0800 for lustre-MDT0001 00000020:00000080:0.0:1788684277.898175:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6748214000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e for lustre-MDT0001 00000020:00000080:0.0:1788684277.899811:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664798d800 for lustre-MDT0001 00000020:00000080:0.0:1788684277.899818:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677e50a000 for lustre-MDT0001 00000001:00100000:1.0:1788684277.900182:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:1.0:1788684277.900207:0:9488:0:(genops.c:885:class_export_put()) final put ffff8d677fbf8000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000001:00100000:3.0:1788684277.902012:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:3.0:1788684277.902020:0:8406:0:(genops.c:885:class_export_put()) final put ffff8d6647915800/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e 00000020:00000080:2.0:1788684277.903289:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fa9a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788684277.903357:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fbf8000/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e for lustre-OST0001 00000020:00000080:2.0:1788684277.903392:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6645994800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788684277.903410:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6647915800/0eb7f700-7065-4a98-9ec9-c4bbe6317e8e for lustre-OST0000 00000020:00000080:2.0:1788684277.903444:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677fa98000 for lustre-OST0001 00000020:00000080:2.0:1788684277.903824:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677fbfe000 for lustre-OST0001 00000020:00000080:2.0:1788684277.903828:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6645997000 for lustre-OST0000 00000020:00000080:2.0:1788684277.903832:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6647914000 for lustre-OST0000 00010000:00010000:3.0:1788684278.399706:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684279.423645:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684279.933675:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085829120:0@lo:400:kworker.0 00000100:00100000:3.0:1788684279.933739:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684279.933793:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085829632:0@lo:400:kworker.0 00000100:00100000:3.0:1788684279.933815:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684279.933842:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788684279.933850:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085828992:0@lo:400:kworker.0 00000100:00100000:3.0:1788684279.933884:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684279.933901:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085829504:0@lo:400:kworker.0 00000100:00100000:3.0:1788684279.933921:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684279.933948:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085829120 00000100:00100000:3.0:1788684279.933956:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085829120 00000100:00100000:3.0:1788684279.933988:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085829632 00000100:00100000:3.0:1788684279.933991:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085829632 00000100:00100000:3.0:1788684279.934016:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085828992 00000100:00100000:3.0:1788684279.934019:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085828992 00000100:00100000:3.0:1788684279.934027:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085829504 00000100:00100000:3.0:1788684279.934030:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085829504 00000100:00100000:3.0:1788684279.934040:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788684279.934048:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085829632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684279.934095:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085829632:12345-0@lo:400:kworker.0 Request processed in 48us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684279.934102:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788684279.934119:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788684279.934122:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875571085829120:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788684279.934156:0:7963:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788684279.934185:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875571085829120:12345-0@lo:400:kworker.0 Request processed in 61us (447us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788684279.934192:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788684279.934211:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788684279.934218:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875571085828992:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788684279.934224:0:6499:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788684279.934257:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875571085828992:12345-0@lo:400:kworker.0 Request processed in 38us (384us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788684279.934315:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085828864:0@lo:400:kworker.0 00000100:00100000:2.0:1788684279.934349:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684279.934389:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085829376:0@lo:400:kworker.0 00000100:00100000:2.0:1788684279.934424:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684279.934443:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788684279.934449:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085828736:0@lo:400:kworker.0 00000100:00100000:2.0:1788684279.934474:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684279.935030:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085829248:0@lo:400:kworker.0 00000100:00100000:2.0:1788684279.935058:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684279.935072:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085829760:0@lo:400:kworker.0 00000100:00100000:2.0:1788684279.935088:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684279.935117:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085828736 00000100:00100000:2.0:1788684279.935121:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085828736 00000100:00100000:2.0:1788684279.935166:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788684279.935174:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:3624:x1875571085828736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684279.935224:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674884dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eb0a8256-d625-4e80-aa6e-17b94cff8c50+19:3624:x1875571085828736:12345-0@lo:400:kworker.0 Request processed in 40us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684279.935251:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788684279.935304:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085828736:0@lo:400:kworker.0 00000100:00100000:2.0:1788684279.935337:0:13784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085829248 00000100:00100000:2.0:1788684279.935341:0:13784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085829248 00000100:00100000:3.0:1788684279.937940:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788684279.937963:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875571085829504:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788684279.937974:0:7963:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788684279.938048:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875571085829504:12345-0@lo:400:kworker.0 Request processed in 87us (4125us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788684279.938056:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1788684279.938112:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788684279.938116:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d677e125800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788684279.938120:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788684279.939447:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684279.939472:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085828864 00000100:00100000:0.0:1788684279.939481:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085828864 00000100:00100000:0.0:1788684279.939530:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788684279.939536:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875571085828864:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788684279.939544:0:6503:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788684279.939602:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1875571085828864:12345-0@lo:400:kworker.0 Request processed in 65us (5251us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788684279.939608:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788684279.939629:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085829376 00000100:00100000:0.0:1788684279.939632:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085829376 00000100:00100000:0.0:1788684279.939658:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085829760 00000100:00100000:0.0:1788684279.939660:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085829760 00000100:00100000:0.0:1788684279.939675:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788684279.939680:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085829376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684279.939713:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085829376:12345-0@lo:400:kworker.0 Request processed in 33us (5289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684279.939718:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788684279.939727:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788684279.939731:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085829760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684279.939864:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085829760:12345-0@lo:400:kworker.0 Request processed in 132us (4774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684279.939871:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1788684279.940532:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684279.940535:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684279.940544:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684279.940569:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085829888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684279.940605:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684279.940669:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085829760:0@lo:400:kworker.0 00000100:00080000:0.0:1788684279.940682:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788684279.940686:0:3624:0:(import.c:65:import_set_state_nolock()) ffff8d677dfd4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788684279.940689:0:3624:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788684279.940695:0:3624:0:(import.c:65:import_set_state_nolock()) ffff8d677dfd4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684279.940699:0:3624:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 141 00000100:00080000:0.0:1788684279.940704:0:3624:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d677dfd4000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684279.940723:0:3624:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648556680 x1875571085830016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684279.943806:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085828864:0@lo:400:kworker.0 00000100:00100000:0.0:1788684279.943850:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085829376:0@lo:400:kworker.0 00000100:00100000:0.0:1788684279.944157:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085830016:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788684279.944235:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684279.944303:0:9159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085830016 00000100:00100000:0.0:1788684279.944310:0:9159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085830016 00000100:00100000:0.0:1788684279.944343:0:9159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788684279.944349:0:9159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1875571085830016:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788684279.944383:0:9159:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788684279.945159:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788684279.945193:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085829888 00000100:00100000:1.0:1788684279.945199:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085829888 00000100:00100000:1.0:1788684279.945232:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788684279.945239:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085829888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684279.945266:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684279.945322:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085829888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (4716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684279.945342:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788684279.945455:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085829888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684279.949499:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788684279.949524:0:13784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085829248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684279.949619:0:13784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085829248:12345-0@lo:400:kworker.0 Request processed in 108us (14559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684279.949628:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00080000:1.0:1788684279.950088:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664859bb80 x1875571085829248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684279.950103:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085829248:0@lo:400:kworker.0 00000100:00080000:3.0:1788684279.956764:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d677e125800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684279.956774:0:3626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 141 00000100:00080000:3.0:1788684279.956785:0:3626:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d677e125800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684279.956822:0:3626:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a6680 x1875571085830144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684279.956861:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085828992:0@lo:400:kworker.0 00000100:00080000:3.0:1788684279.956892:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788684279.956896:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d664740b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788684279.956899:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788684279.956902:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d664740b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684279.956904:0:3626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 177 00000100:00100000:2.0:1788684279.956917:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085830144:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788684279.956921:0:3626:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d664740b800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684279.956936:0:3626:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a6d80 x1875571085830272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684279.956946:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085829504:0@lo:400:kworker.0 00000100:00080000:3.0:1788684279.956959:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788684279.956962:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d678003d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788684279.956964:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788684279.956967:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d678003d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684279.956970:0:3626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 158 00000100:00080000:3.0:1788684279.956973:0:3626:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d678003d800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684279.956974:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684279.956983:0:3626:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a4380 x1875571085830400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684279.956991:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085829120:0@lo:400:kworker.0 00010000:00080000:3.0:1788684279.957005:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648599500 x1875571085829632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684279.957007:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085830272:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788684279.957016:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085829632:0@lo:400:kworker.0 00000100:00100000:2.0:1788684279.957026:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684279.957043:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085830400:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788684279.957060:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684279.957070:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085830144 00000100:00100000:3.0:1788684279.957076:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085830144 00000100:00100000:2.0:1788684279.957083:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085830272 00000100:00100000:2.0:1788684279.957086:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085830272 00000100:00100000:3.0:1788684279.957102:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085830400 00000100:00100000:3.0:1788684279.957104:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085830400 00000100:00100000:2.0:1788684279.970207:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788684279.970219:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085830144:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788684279.970239:0:6498:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788684279.970509:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085830144:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 289us (13533us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788684279.970518:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788684279.970536:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788684279.970540:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085830272:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788684279.970564:0:6498:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788684279.970590:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085830272:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 48us (13563us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788684279.970596:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788684279.970610:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788684279.970614:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085830400:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788684279.970621:0:6498:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788684279.970644:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085830400:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 28us (13583us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788684279.970650:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1788684279.970700:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664740b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684279.970704:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788684279.970708:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085830272:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788684279.970718:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d678003d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684279.970721:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788684279.970724:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085830400:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788684279.970740:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677e125800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684279.970743:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788684279.970745:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085830144:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788684279.993716:0:9159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1875571085830016:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 49357us (49473us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788684279.993740:0:9159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1788684279.994643:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677dfd4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684279.994652:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788684279.994656:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085830016:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1788684280.446199:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684280.446209:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684280.446229:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085830528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684280.446298:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684280.446542:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085830528 00000100:00100000:1.0:1788684280.446550:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085830528 00000100:00100000:1.0:1788684280.446640:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788684280.446649:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085830528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684280.446689:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788684280.446731:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085830528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684280.446737:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788684280.457255:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085830528:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788684280.766500:0:13776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788684281.470129:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788684281.984529:0:6476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788684281.984543:0:6476:0:(genops.c:885:class_export_put()) final put ffff8d677cc88800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788684281.984729:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc88800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788684281.984825:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6775f85800 for lustre-MDT0000 00000020:01000000:2.0:1788684282.111655:0:15181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6646ea2c60 - data ffff8d6767734000/ffff8d664776a800 00000020:01000000:2.0:1788684282.111857:0:15181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6748018960 - data ffff8d6767579288/ffff8d6775ef2000 00000001:00000004:2.0:1788684282.123338:0:15181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:0.0:1788684282.205288:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788684282.205297:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788684282.205311:0:15181:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d6648598000 x1875571085828352/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788684286 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684282.205335:0:15181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788684282.214855:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788684282.214864:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788684282.214885:0:15181:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684282.214888:0:15181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788684282.215197:0:8887:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788684282.215202:0:8887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788684282.215213:0:8887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788684282.215925:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788684282.215929:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788684282.215942:0:15181:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684282.215945:0:15181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788684282.217227:0:9986:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788684282.217234:0:9986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788684282.217246:0:9986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788684282.223085:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abe75 00000020:00000080:1.0:1788684282.223095:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6751b77800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788684282.229072:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abe8a 00000020:00000080:1.0:1788684282.229087:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6758ee1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788684282.229252:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6751b77800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788684282.233031:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788684282.233047:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684282.233071:0:15181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788684282.233076:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8d67482e19c0) has no exports 00000020:00000080:2.0:1788684282.233481:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6758ee1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788684282.233706:0:15181:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788684282.233717:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac2c0 00000020:00000080:1.0:1788684282.233726:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d677fa9f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788684282.233741:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788684282.233746:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684282.233756:0:15181:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684282.233759:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8d6647433380) has no exports 00000020:00000080:1.0:1788684282.233765:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac2b9 00000020:00000080:1.0:1788684282.233769:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6647739800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788684282.234095:0:15181:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788684282.234100:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788684282.234104:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788684282.234120:0:15181:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684282.234123:0:15181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684282.234151:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684282.234159:0:15181:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788684282.234166:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac17e 00000020:00000080:1.0:1788684282.234170:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6645995000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788684282.234174:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788684282.234177:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684282.234181:0:15181:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684282.234183:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8d67772199c0) has no exports 00000020:00000080:1.0:1788684282.234186:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac177 00000020:00000080:1.0:1788684282.234189:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6645997800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788684282.234989:0:15181:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788684282.234994:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788684282.234997:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788684282.235001:0:15181:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684282.235003:0:15181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684282.235035:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684282.235051:0:15181:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788684282.235065:0:15181:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788684282.235072:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac043 00000020:00000080:1.0:1788684282.235078:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d677dfd7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788684282.235083:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788684282.235087:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684282.235091:0:15181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684282.235095:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d677e3e8000) has no exports 00000020:00000080:1.0:1788684282.235099:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac03c 00000020:00000080:1.0:1788684282.235102:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d677cc89000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788684282.235211:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fa9f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788684282.235220:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6647739800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788684282.235226:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664773d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788684282.235232:0:14645:0:(genops.c:885:class_export_put()) final put ffff8d664740d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788684282.235234:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664740d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788684282.235238:0:14645:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788684282.235336:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6645995000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788684282.235342:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6645997800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788684282.235346:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cefb000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788684282.235352:0:14645:0:(genops.c:885:class_export_put()) final put ffff8d677fa0b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788684282.235354:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fa0b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788684282.235358:0:14645:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788684282.235418:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677dfd7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788684282.236186:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc89000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788684282.240247:0:15181:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788684282.240267:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788684282.240271:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788684282.240279:0:15181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788684282.240337:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684282.240349:0:15181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788684282.240403:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684282.240406:0:15181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788684282.240412:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6751b76800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788684282.240416:0:15181:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6751b76800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788684282.240437:0:15181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788684282.240570:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abe91 00000020:00000080:0.0:1788684282.240577:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6751b73000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788684282.240582:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788684282.240586:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684282.240591:0:15181:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788684282.240594:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8d67482e4d40) has no exports 00000020:00000080:0.0:1788684282.240613:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684282.240616:0:15181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788684282.240620:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abe98 00000020:00000080:0.0:1788684282.240634:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6751b73800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788684282.240643:0:15181:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d67466b4800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788684282.240646:0:15181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67466b4800 3 00000020:01000004:0.0:1788684282.240649:0:15181:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d67466b4800 from lustre-MDT0000 00000020:00000080:0.0:1788684282.240666:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684282.240670:0:15181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788684282.240672:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6751b71000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788684282.240674:0:15181:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6751b71000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788684282.240684:0:15181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788684282.240717:0:15181:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788684282.240722:0:15181:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788684282.240724:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788684282.240727:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684282.240730:0:15181:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788684282.240736:0:15181:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8d6748213000 eb0a8256-d625-4e80-aa6e-17b94cff8c50 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684282.240742:0:15181:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8d6748250000) has exports, disconnecting them 00000020:00080000:0.0:1788684282.240746:0:15181:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d6748213000), last request at 1788684042 00000020:00000080:0.0:1788684282.240763:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abe36 00000020:00010000:0.0:1788684282.240767:0:15181:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d6748213000: total 2 00000100:00080000:0.0:1788684282.240770:0:15181:0:(import.c:65:import_set_state_nolock()) ffff8d6748216800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788684282.240782:0:15181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6748213000): rc 0 00000020:00080000:0.0:1788684282.240785:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8d6748250000) has no exports 00000100:00100000:0.0:1788684282.240849:0:6491:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d6750187e00:6491] 2 exiting: rc = 0 00000020:00010000:2.0:1788684282.241230:0:9499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d6748213000: total 2 00010000:00010000:2.0:1788684282.241288:0:9499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d6748213000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788684282.241319:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711c200/0x44bac02bd54ac5d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac5d0 expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241336:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a0600/0x44bac02bd54ac37d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac376 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241361:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148ba00/0x44bac02bd54abf32 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54abf2b expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241412:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740031e00/0x44bac02bd54abf40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54abf39 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241423:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711d800/0x44bac02bd54ac5c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac5c2 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241444:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477ffc00/0x44bac02bd54ac3a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac3a0 expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241453:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6740030a00/0x44bac02bd54ac337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac330 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241463:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647890600/0x44bac02bd54ac5e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac5de expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241475:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d674148ac00/0x44bac02bd54ac257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac250 expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241485:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477fe000/0x44bac02bd54ac353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac34c expref: 5 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241494:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477fe800/0x44bac02bd54ac345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac33e expref: 4 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241504:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477fec00/0x44bac02bd54ac361 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac35a expref: 3 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241527:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477fea00/0x44bac02bd54ac36f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ac368 expref: 2 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684282.241537:0:9499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d6748213000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788684282.241552:0:9499:0:(genops.c:885:class_export_put()) final put ffff8d6748213000/eb0a8256-d625-4e80-aa6e-17b94cff8c50 00010000:00010000:2.0:1788684282.241558:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684282.241560:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684282.241562:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684282.241616:0:6489:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d6743e33200:6489] 0 exiting: rc = 1 00000100:00100000:2.0:1788684282.241682:0:6490:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d6767bccc00:6490] 1 exiting: rc = 0 00000020:00000080:2.0:1788684282.241731:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cc8f000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788684282.241737:0:14645:0:(genops.c:885:class_export_put()) final put ffff8d677cc8b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788684282.241739:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc8b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788684282.241748:0:14645:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788684282.241789:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6751b73000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788684282.241794:0:14645:0:(genops.c:885:class_export_put()) final put ffff8d6751b75800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788684282.241796:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6751b75800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788684282.241800:0:14645:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788684282.241829:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6751b73800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788684282.241833:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6748213000/eb0a8256-d625-4e80-aa6e-17b94cff8c50 for MGS 00000020:00000080:2.0:1788684282.241859:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6748216800 for MGS 00000100:00100000:0.0:1788684282.242277:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242286:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242292:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242298:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242304:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242310:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242316:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242322:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242329:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242344:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242350:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242357:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242363:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242390:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242405:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242411:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242417:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242423:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242660:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242666:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242672:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242679:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242685:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242691:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242698:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242704:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242710:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242715:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242721:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242727:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242733:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242739:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242744:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242749:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242755:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242760:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242765:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242771:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242776:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242781:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242785:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242790:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242795:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242800:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242812:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242817:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242821:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242825:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242830:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242836:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242841:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242846:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242851:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242856:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242862:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242868:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242873:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242878:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242883:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242888:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242894:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242899:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242905:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684282.242910:0:15181:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788684282.246060:0:15181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6645bc7120 - data ffff8d6645ce2870/ffff8d677e4ac800 00000020:01000000:0.0:1788684282.246233:0:15181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6774804ae0 - data ffff8d676742d1b0/ffff8d6744cea000 00000020:00000080:0.0:1788684282.246941:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abe1a 00000020:00000080:0.0:1788684282.246951:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d67488f8800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788684282.247005:0:15181:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d67466b4800 from MGS, refs=2 00000020:01000004:0.0:1788684282.247010:0:15181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67466b4800 2 00000020:01000004:0.0:1788684282.247013:0:15181:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d67466b4800 from MGS 00000020:00000080:0.0:1788684282.247032:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684282.247039:0:15181:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788684282.247042:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d67488fa000/MGS 00000020:00000080:0.0:1788684282.247045:0:15181:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488fa000/MGS for MGS 00000020:01000000:0.0:1788684282.247052:0:15181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788684282.247141:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788684282.247146:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684282.247164:0:15181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788684282.247171:0:15181:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d6775f87800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684282.247179:0:15181:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8d6750b78000) has exports, disconnecting them 00000020:00080000:0.0:1788684282.247184:0:15181:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d6775f87800), last request at 1788684043 00000020:00000080:0.0:1788684282.247188:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abee5 00000020:00080000:0.0:1788684282.247199:0:15181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6775f87800): rc 0 00000020:00000080:0.0:1788684282.247204:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6775f87800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788684282.251639:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488f8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788684282.253173:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775f87800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788684282.255355:0:15181:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788684282.255401:0:15181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788684282.255405:0:15181:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788684282.255413:0:15181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788684282.255480:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6775f82000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788684282.255657:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684282.255665:0:15181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788684282.255670:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d6780039800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788684282.255673:0:15181:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6780039800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788684282.255683:0:15181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788684282.255751:0:15181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67466b4800 1 00000020:00000080:2.0:1788684282.255756:0:15181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abe0c 00000020:00000080:2.0:1788684282.255762:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d67488f8000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788684282.255771:0:15181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788684282.255780:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788684282.255788:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684282.256266:0:15181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788684282.256271:0:15181:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8d6750b7b380) has no exports 00000020:00000080:3.0:1788684282.451743:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788684282.451755:0:15181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788684282.451761:0:15181:0:(genops.c:885:class_export_put()) final put ffff8d67749de000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788684282.451766:0:15181:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67749de000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788684282.451771:0:15181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788684282.456351:0:15181:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d67466b3800 00000020:02000400:3.0:1788684282.456446:0:15181:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788684282.497720:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684283.517548:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684284.545274:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684285.057233:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684285.057265:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085830656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684285.057332:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684285.057622:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085830656 00000100:00100000:1.0:1788684285.057630:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085830656 00000100:00100000:1.0:1788684285.057684:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788684285.057694:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085830656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684285.057722:0:14146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788684285.057766:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085830656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684285.057773:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788684285.057793:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684285.057827:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085830656:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788684285.060676:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684285.060682:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788684285.060685:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d677dfd4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684285.060693:0:14645:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 360 00000100:00080000:0.0:1788684285.060698:0:14645:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684285.060704:0:14645:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d677dfd4000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684285.060726:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648555f80 x1875571085830912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684285.060742:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684285.060745:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788684285.060747:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d677e125800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684285.060750:0:14645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 360 00000100:00080000:0.0:1788684285.060752:0:14645:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684285.060756:0:14645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d677e125800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684285.060767:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648557800 x1875571085831040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684285.060775:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684285.060788:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788684285.060790:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d678003d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684285.060794:0:14645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 360 00000100:00080000:0.0:1788684285.060797:0:14645:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684285.060800:0:14645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d678003d800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684285.060814:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648555880 x1875571085831168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684285.060830:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684285.060833:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788684285.060835:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d664740b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684285.060838:0:14645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 360 00000100:00080000:0.0:1788684285.060840:0:14645:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684285.060843:0:14645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d664740b800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684285.060853:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648557b80 x1875571085831424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684285.060900:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085830784:0@lo:400:kworker.0 00000400:00000100:0.0:1788684285.060942:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875571085830784 offset 0 length 224: 4 00000100:00100000:0.0:1788684285.060981:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684285.060987:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085831296:0@lo:400:kworker.0 00000100:00100000:0.0:1788684285.063062:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684285.063310:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085831296 00000100:00100000:1.0:1788684285.063318:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085831296 00000100:00100000:0.0:1788684285.063575:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085830912:0@lo:38:kworker.0 00000100:00100000:0.0:1788684285.063613:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684285.063634:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085831040:0@lo:38:kworker.0 00000100:00100000:0.0:1788684285.063656:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684285.063743:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684285.063845:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085831168:0@lo:38:kworker.0 00000100:00100000:0.0:1788684285.063870:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684285.063923:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085831040 00000100:00100000:1.0:1788684285.063927:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085831040 00000100:00100000:1.0:1788684285.063952:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788684285.063961:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085831296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684285.064024:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085831296:12345-0@lo:400:kworker.0 Request processed in 65us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684285.064032:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788684285.064052:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788684285.064056:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085831040:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788684285.064073:0:6498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788684285.064123:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085831040:12345-0@lo:38:kworker.0 Request processed in 65us (465us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788684285.064130:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788684285.064148:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085830912 00000100:00100000:1.0:1788684285.064152:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085830912 00000100:00100000:1.0:1788684285.064169:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788684285.064174:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085830912:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788684285.064184:0:6503:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788684285.064210:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085830912:12345-0@lo:38:kworker.0 Request processed in 34us (596us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788684285.064216:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788684285.064861:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085831424:0@lo:38:kworker.0 00000100:00100000:0.0:1788684285.064888:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788684285.064918:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677dfd4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684285.064923:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788684285.064926:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085830912:0@lo:38:kworker.0 00000100:00080000:0.0:1788684285.064936:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677e125800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684285.064939:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788684285.064942:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085831040:0@lo:38:kworker.0 00000100:00100000:0.0:1788684285.065095:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085831168 00000100:00100000:0.0:1788684285.065100:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085831168 00000100:00100000:0.0:1788684285.065123:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085831424 00000100:00100000:0.0:1788684285.065126:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085831424 00000100:00100000:0.0:1788684285.065136:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788684285.065142:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1875571085831168:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788684285.065153:0:7963:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788684285.065186:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1875571085831168:12345-0@lo:38:kworker.0 Request processed in 43us (1314us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788684285.065192:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788684285.065207:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788684285.065211:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1875571085831424:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788684285.065220:0:7963:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788684285.065258:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1875571085831424:12345-0@lo:38:kworker.0 Request processed in 44us (367us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788684285.065274:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1788684285.065300:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d678003d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684285.065303:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788684285.065307:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085831168:0@lo:38:kworker.0 00000100:00080000:0.0:1788684285.065315:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664740b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684285.065318:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788684285.065320:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085831424:0@lo:38:kworker.0 00000100:00100000:0.0:1788684285.065345:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085831680:0@lo:400:kworker.0 00000100:00100000:0.0:1788684285.065403:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788684285.065622:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8d6648557100 x1875571085831296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684285.065634:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085831296:0@lo:400:kworker.0 00000100:00100000:0.0:1788684285.065772:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684285.065779:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085831552:0@lo:400:kworker.0 00000100:00100000:0.0:1788684285.065803:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684285.065826:0:7963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085831552 00000100:00100000:0.0:1788684285.065829:0:7963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085831552 00000100:00100000:0.0:1788684285.065864:0:7963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788684285.065871:0:7963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085831552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684285.065909:0:7963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085831552:12345-0@lo:400:kworker.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684285.065914:0:7963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00080000:0.0:1788684285.065939:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8d6648556680 x1875571085831552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684285.065948:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085831552:0@lo:400:kworker.0 00000100:00080000:3.0:1788684285.066936:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788684285.067332:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085831680 00000100:00100000:1.0:1788684285.067340:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085831680 00000100:00100000:1.0:1788684285.067434:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788684285.067444:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085831680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684285.067510:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085831680:12345-0@lo:400:kworker.0 Request processed in 68us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684285.067523:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788684285.067568:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085831680:0@lo:400:kworker.0 00000100:00080000:3.0:1788684285.068435:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684285.566597:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085831808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684285.566664:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684285.566961:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085831808 00000100:00100000:1.0:1788684285.566970:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085831808 00000100:00100000:1.0:1788684285.567024:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788684285.567033:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085831808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684285.567056:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788684285.567112:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085831808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684285.567120:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788684285.567171:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085831808:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788684285.568020:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684286.591333:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788684286.725859:0:15382:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788684286.741030:0:15382:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788684286.741093:0:15382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684286.741107:0:15382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684286.741114:0:15382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684286.741187:0:15382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684286.741224:0:15382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788684286.741229:0:15382:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788684286.741674:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788684286.741678:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788684286.741685:0:15382:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788684286.741690:0:15382:0:(import.c:65:import_set_state_nolock()) ffff8d677e125800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788684286.741695:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788684286.741696:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788684286.741699:0:15382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788684286.742823:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684286.742833:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684286.742854:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684286.742858:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684286.742867:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684286.742873:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684286.742879:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788684286.742881:0:9499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788684286.742884:0:9499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788684286.742919:0:9499:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684286.742926:0:9499:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684286.742961:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684286.742969:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54ac368 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac36f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684286.742982:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684286.742984:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684286.742986:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684286.743050:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085831936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684286.743136:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684286.743449:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085831936 00000100:00100000:0.0:1788684286.743456:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085831936 00000100:00100000:0.0:1788684286.743511:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788684286.743518:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3624:x1875571085831936:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788684286.743532:0:6482:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684286 with bad export cookie 4952482034741853750 00010000:00010000:1.0:1788684286.749574:0:15382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749593:0:15382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749601:0:15382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749608:0:15382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749623:0:15382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684286.749630:0:15382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749656:0:15382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749662:0:15382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749667:0:15382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749683:0:15382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788684286.749694:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684286.749700:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749706:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740031c00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684286.749710:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749718:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684286.749726:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684286.749731:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788684286.749733:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1788684286.749778:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749795:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684286.749819:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749827:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740031c00/0x44bac02bd54ac376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac37d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749842:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684286.749846:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749852:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a6800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684286.749855:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749862:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684286.749868:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684286.749874:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788684286.749876:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788684286.749878:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788684286.749892:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749899:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684286.749904:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749921:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a6800/0x44bac02bd54ac250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac257 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.749935:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684286.749937:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684286.749939:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684286.749957:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085832192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684286.750020:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684286.750061:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684286.750067:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085832064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684286.750088:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684286.750116:0:15382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750125:0:15382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750131:0:15382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750137:0:15382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750150:0:15382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684286.750155:0:15382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750162:0:15382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750175:0:15382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750180:0:15382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750193:0:15382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788684286.750196:0:15382:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788684286.750199:0:15382:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1788684286.750229:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684286.750233:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750239:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684286.750242:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750249:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684286.750255:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684286.750260:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788684286.750262:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788684286.750263:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788684286.750277:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684286.750278:0:6485:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684286.750283:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750284:0:6485:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684286.750289:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67560a6000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684286.750292:0:6486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684286.750299:0:6486:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750303:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684286.750306:0:6486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684286.750309:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66479a1800/0x44bac02bd54ac5de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ac5e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684286.750316:0:6486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788684286.750318:0:6486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1788684286.750318:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788684286.750320:0:6486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788684286.750320:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684286.750321:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684286.750332:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085832320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684286.750334:0:6486:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684286.750339:0:6486:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684286.750344:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684286.750350:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a6000/0x44bac02bd54abf39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54abf40 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684286.750356:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684286.750362:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684286.750397:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684286.750399:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684286.751493:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684286.751505:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085832448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684286.751540:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684286.751568:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085832192 00000100:00100000:1.0:1788684286.751575:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085832192 00000100:00100000:1.0:1788684286.751599:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085832064 00000100:00100000:1.0:1788684286.751602:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085832064 00000100:00100000:1.0:1788684286.751610:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085832320 00000100:00100000:1.0:1788684286.751612:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085832320 00000100:00100000:1.0:1788684286.751618:0:9510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085832448 00000100:00100000:1.0:1788684286.751620:0:9510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085832448 00000100:00100000:1.0:1788684286.751632:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788684286.751637:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674834b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1875571085832192:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788684286.751644:0:9510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684286 with bad export cookie 4952482034741853750 00000100:00100000:1.0:1788684286.751694:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674834b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1875571085832192:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (1673us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788684286.751701:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788684286.751717:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684286.751721:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1875571085832064:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788684286.751748:0:9510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684286 with bad export cookie 4952482034741853750 00000100:00100000:1.0:1788684286.751775:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1875571085832064:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1686us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788684286.751781:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684286.751794:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684286.751798:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875571085832320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788684286.751801:0:9510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684286 with bad export cookie 4952482034741853750 00000100:00100000:1.0:1788684286.751842:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875571085832320:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (1485us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788684286.751848:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684286.751858:0:9510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788684286.751862:0:9510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875571085832448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788684286.751865:0:9510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684286 with bad export cookie 4952482034741853750 00000100:00100000:1.0:1788684286.751888:0:9510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875571085832448:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (347us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788684286.751893:0:9510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000020:01000004:1.0:1788684286.751924:0:15382:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788684286.751929:0:15382:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788684286.751933:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684286.751938:0:15382:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788684286.751944:0:15382:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8d664672b800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788684286.751949:0:15382:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8d664672b000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788684286.751954:0:15382:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8d677cf2b380) has exports, disconnecting them 00000020:00080000:1.0:1788684286.751959:0:15382:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d664672b800), last request at 1788684285 00000020:00000080:1.0:1788684286.751966:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac218 00000100:00080000:1.0:1788684286.751982:0:15382:0:(import.c:65:import_set_state_nolock()) ffff8d6646729800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788684286.752025:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788684286.752037:0:15382:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d664672b800): rc 0 00000020:00000080:1.0:1788684286.752040:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d664672b800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788684286.752049:0:15382:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d664672b000), last request at 1788684285 00000020:00000080:1.0:1788684286.752052:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac0f2 00000100:00080000:1.0:1788684286.752058:0:15382:0:(import.c:65:import_set_state_nolock()) ffff8d664672e800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788684286.752066:0:15382:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d664672b000): rc 0 00000020:00000080:1.0:1788684286.752068:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d664672b000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788684286.752074:0:15382:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb81ec21e3ae0 00000100:00080000:1.0:1788684286.752090:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788684286.752093:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:3.0:1788684286.752215:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664672b800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788684286.752270:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664672b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788684286.752289:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6646729800 for lustre-MDT0001 00000020:00000080:3.0:1788684286.752294:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664672e800 for lustre-MDT0001 00000100:00080000:3.0:1788684286.752318:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788684286.752322:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d677487c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788684286.752325:0:3626:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.144@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788684286.752410:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788684286.758093:0:15382:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788684286.758104:0:15382:0:(import.c:65:import_set_state_nolock()) ffff8d677dfd4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1788684286.761580:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684286.766896:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3624:x1875571085831936:12345-0@lo:103:ldlm_bl.0 Request processed in 23370us (23753us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788684286.766911:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788684286.766990:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788684286.784803:0:3626:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.144@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788684286.784809:0:3626:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788684286.784817:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6648554000 x1875571085830784/t0(0) o400->MGC192.168.206.144@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788684301 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684286.784831:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6648666d80 x1875571085831936/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684302 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684286.784858:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fa73800 x1875571085832192/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684302 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684286.784867:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fa71180 x1875571085832064/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684302 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684286.784875:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fa72d80 x1875571085832320/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684302 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684286.784884:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d66479a4a80 x1875571085832448/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684302 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788684286.784892:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788684286.784895:0:3626:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788684286.784896:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788684286.789218:0:3623:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d677487c800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788684286.789501:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085832320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684286.789515:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085830784:0@lo:400:kworker.0 00000100:00100000:2.0:1788684286.789544:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3623:1875571085832448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684286.789573:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788684286.789666:0:3624:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d677487c800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1788684286.789744:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d677487c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684286.789750:0:3626:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 123 00000100:00080000:3.0:1788684286.789758:0:3626:0:(import.c:665:import_select_connection()) MGC192.168.206.144@tcp: import ffff8d677487c800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684286.789802:0:3626:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a4000 x1875571085832576/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684286.789832:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085832192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684286.789846:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3626:1875571085832064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684286.790422:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3624:1875571085831936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684286.791443:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3622:1875571085832576:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788684286.791500:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875571085832576 offset 0 length 520: 4 00000100:00080000:1.0:1788684286.795937:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788684286.795946:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:1.0:1788684286.795970:0:15382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788684286.796040:0:15382:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788684286.796070:0:15382:0:(import.c:65:import_set_state_nolock()) ffff8d677fa0e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788684286.796088:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788684286.796090:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788684286.796107:0:15382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788684286.796168:0:15382:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788684286.796178:0:15382:0:(import.c:65:import_set_state_nolock()) ffff8d677cef8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788684286.796200:0:15382:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d677cf2b380) has no exports 00000100:00100000:2.0:1788684286.796865:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085832704:0@lo:9:umount.0 00000100:00100000:2.0:1788684286.796931:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684286.796970:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085832832:0@lo:9:umount.0 00000100:00100000:2.0:1788684286.796991:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684286.797169:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085832704 00000100:00100000:3.0:1788684286.797177:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085832704 00000100:00100000:3.0:1788684286.797224:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085832832 00000100:00100000:3.0:1788684286.797227:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085832832 00000100:00100000:3.0:1788684286.797261:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788684286.797270:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875571085832704:12345-0@lo:9:umount.0 00000100:00100000:1.0:1788684286.797272:0:9991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788684286.797278:0:9991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875571085832832:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788684286.797291:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac13f 00000020:00000080:1.0:1788684286.797291:0:9991:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac281 00000100:00080000:3.0:1788684286.797299:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8d677f9b4800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788684286.797305:0:9991:0:(import.c:65:import_set_state_nolock()) ffff8d677fa9f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684286.797346:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788684286.797510:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3622:x1875571085832704:12345-0@lo:9:umount.0 Request processed in 225us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684286.797517:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788684286.797706:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677fa0e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788684286.797723:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788684286.797732:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788684286.797745:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085832704:0@lo:9:umount.0 00000001:00000004:1.0:1788684286.802095:0:9991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788684286.802457:0:9991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3622:x1875571085832832:12345-0@lo:9:umount.0 Request processed in 5174us (5460us total) trans 0 rc 0/0 00010000:00010000:0.0:1788684286.802462:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684286.802469:0:9991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:1.0:1788684286.802496:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788684286.807845:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cef8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788684286.807905:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788684286.811337:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788684286.811352:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085832832:0@lo:9:umount.0 00000020:00080000:2.0:1788684286.821711:0:15382:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d677cf2b380) has no exports 00000020:01000000:3.0:1788684286.867730:0:15382:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d66466f3d20 - data ffff8d6767731000/ffff8d677709e800 00000020:01000000:3.0:1788684286.867880:0:15382:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d67431ad000 - data ffff8d67675afaf8/ffff8d6743f93400 00000001:00000004:3.0:1788684286.877563:0:15382:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788684286.929414:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684286.929423:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788684286.929431:0:15382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788684286.935952:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788684286.935959:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:0.0:1788684286.936035:0:15382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788684286.936038:0:15382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788684286.940518:0:8880:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788684286.940525:0:8880:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788684286.940537:0:8880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788684286.941181:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788684286.941186:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788684286.941197:0:15382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788684286.941199:0:15382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788684286.942613:0:9981:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788684286.942618:0:9981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1788684286.942629:0:9981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788684286.944685:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abf5c 00000020:00000080:2.0:1788684286.944695:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677cf24800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788684286.945334:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf24800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788684286.952644:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abf71 00000020:00000080:2.0:1788684286.952657:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677cf26000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788684286.952670:0:15382:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788684286.952675:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684286.952682:0:15382:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788684286.952686:0:15382:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8d677cf2cd40) has no exports 00000004:01000000:2.0:1788684286.952852:0:15382:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788684286.952859:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac27a 00000020:00000080:2.0:1788684286.952863:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d6646d43800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788684286.952867:0:15382:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788684286.952870:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684286.952877:0:15382:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788684286.952880:0:15382:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8d6777218000) has no exports 00000020:00000080:2.0:1788684286.952885:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac273 00000020:00000080:2.0:1788684286.952889:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d664742a800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788684286.953213:0:15382:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788684286.953218:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788684286.953226:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788684286.953866:0:15382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788684286.953880:0:15382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788684286.953919:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684286.953927:0:15382:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788684286.953934:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac138 00000020:00000080:2.0:1788684286.953939:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677fa0d000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788684286.953944:0:15382:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788684286.953948:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684286.953951:0:15382:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788684286.953954:0:15382:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8d677721b380) has no exports 00000020:00000080:2.0:1788684286.953959:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac131 00000020:00000080:2.0:1788684286.953962:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677fa0f000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788684286.954170:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf26000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788684286.954179:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646d43800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788684286.954184:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664742a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788684286.954188:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cef8000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788684286.954194:0:36:0:(genops.c:885:class_export_put()) final put ffff8d664742e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788684286.954196:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664742e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788684286.954200:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788684286.954272:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fa0d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788684286.954277:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fa0f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788684286.956900:0:15382:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788684286.956908:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788684286.956912:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:2.0:1788684286.956919:0:15382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788684286.956922:0:15382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788684286.957272:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684286.957283:0:15382:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788684286.957296:0:15382:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788684286.957303:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abf94 00000020:00000080:2.0:1788684286.957312:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677cc89800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788684286.962554:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677fa0e000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788684286.962573:0:36:0:(genops.c:885:class_export_put()) final put ffff8d6645993000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788684286.962577:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6645993000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788684286.962587:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788684286.970279:0:15382:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788684286.970319:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684286.970331:0:15382:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788684286.970336:0:15382:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8d67482519c0) has no exports 00000020:00000080:2.0:1788684286.970346:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abf8d 00000020:00000080:2.0:1788684286.970354:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677dfd5800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788684286.970505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc89800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788684286.970522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677dfd5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788684286.992925:0:15382:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788684286.992933:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788684286.992938:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788684286.992947:0:15382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788684286.993040:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684286.993060:0:15382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788684286.993209:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677dfd4000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788684286.993224:0:36:0:(genops.c:885:class_export_put()) final put ffff8d677dfd7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788684286.993228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677dfd7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788684286.993304:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788684286.993552:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684286.993557:0:15382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788684286.993561:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677cf22800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788684286.993563:0:15382:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf22800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788684286.993570:0:15382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788684286.993710:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abf78 00000020:00000080:2.0:1788684286.993716:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677cf27000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788684286.993734:0:15382:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788684286.993738:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684286.993743:0:15382:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788684286.993746:0:15382:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8d677cf299c0) has no exports 00000020:00000080:2.0:1788684286.993766:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684286.993769:0:15382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788684286.993773:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abf7f 00000020:00000080:2.0:1788684286.993777:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677cf22000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788684286.993785:0:15382:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d677cc6f800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788684286.993788:0:15382:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677cc6f800 2 00000020:01000004:2.0:1788684286.993791:0:15382:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d677cc6f800 from lustre-MDT0001 00000020:00000080:2.0:1788684286.993807:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684286.993810:0:15382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788684286.993813:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677cf24000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788684286.993815:0:15382:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf24000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788684286.993822:0:15382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788684286.993850:0:15382:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788684286.993854:0:15382:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788684286.993858:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684286.993861:0:15382:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788684286.993868:0:15382:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8d677e1fb000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788684286.993873:0:15382:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8d677e140000) has exports, disconnecting them 00000020:00080000:2.0:1788684286.993878:0:15382:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8d677e1fb000), last request at 1788684060 00000020:00000080:2.0:1788684286.993889:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abfd3 00000020:00080000:2.0:1788684286.993902:0:15382:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d677e1fb000): rc 0 00000020:00000080:2.0:1788684286.993905:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677e1fb000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788684286.994200:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf27000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788684286.994206:0:36:0:(genops.c:885:class_export_put()) final put ffff8d677cf23800/lustre-MDD0001_UUID 00000020:00000080:3.0:1788684286.994208:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf23800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788684286.994212:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788684286.994680:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf22000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788684286.994686:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677e1fb000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788684287.008458:0:15382:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788684287.008466:0:15382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788684287.008470:0:15382:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788684287.008477:0:15382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788684287.008565:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677e125800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788684287.008654:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684287.008662:0:15382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788684287.008667:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677e122000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788684287.008671:0:15382:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677e122000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788684287.008679:0:15382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788684287.008742:0:15382:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677cc6f800 1 00000020:00000080:2.0:1788684287.008748:0:15382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abf0f 00000020:00000080:2.0:1788684287.008753:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677cc6d800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788684287.008769:0:15382:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788684287.008773:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684287.008778:0:15382:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788684287.008781:0:15382:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8d6748253380) has no exports 00000020:00000080:3.0:1788684287.009149:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc6d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788684287.092734:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788684287.092747:0:15382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788684287.092752:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d677cc6c000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788684287.092756:0:15382:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc6c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788684287.092763:0:15382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788684287.092882:0:15382:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d677cc6c800 00000020:01000000:3.0:1788684287.092900:0:15382:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788684287.092904:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684287.092908:0:15382:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788684287.092911:0:15382:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8d6750b799c0) has no exports 00000100:00100000:2.0:1788684287.093331:0:6498:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d6743e32200:6498] 1 exiting: rc = 0 00000100:00100000:2.0:1788684287.093461:0:6499:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d678002d600:6499] 2 exiting: rc = 0 00000100:00100000:2.0:1788684287.093562:0:6497:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d677482da00:6497] 0 exiting: rc = 1 00000100:00100000:2.0:1788684287.093794:0:13784:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff8d67771abc00:13784] 5 exiting: rc = 0 00000100:00100000:0.0:1788684287.094162:0:7963:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d677e329a00:7963] 3 exiting: rc = 0 00000100:00100000:0.0:1788684287.099139:0:12443:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8d664799ae00:12443] 4 exiting: rc = 0 00000100:00100000:0.0:1788684287.108859:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108871:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108877:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108882:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108888:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108894:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108899:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108904:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108909:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108926:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108932:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108937:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108943:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108947:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108953:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108958:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108964:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108969:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108975:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108980:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108986:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108990:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.108996:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109001:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109577:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109584:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109590:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109595:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109601:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109605:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109610:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109614:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109619:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109625:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109631:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109636:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109642:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109647:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109653:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109658:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109664:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109669:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109673:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109679:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109692:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109698:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109703:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109709:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109714:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109720:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109725:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109729:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109735:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109739:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109744:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109749:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109754:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109759:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109764:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109770:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109774:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109779:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109785:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.109790:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.115078:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d678002de00:6500] 0 exiting: rc = 1 00000100:00100000:2.0:1788684287.117758:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d678002d400:6501] 1 exiting: rc = 0 00000100:00100000:0.0:1788684287.118412:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118420:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118426:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118432:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118438:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118443:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118448:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118453:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118459:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118464:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118469:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118475:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118481:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118486:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118502:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118507:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118512:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118518:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118524:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118529:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118534:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118539:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118544:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118548:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118553:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118558:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118562:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118567:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118572:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118577:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118582:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118587:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118591:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118596:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118600:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118604:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118609:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118613:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118618:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118623:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118627:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118632:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118636:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118640:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118644:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118649:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118653:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118657:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118662:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118672:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118677:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118682:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118687:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118692:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118697:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118701:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118706:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118711:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118715:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118719:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118724:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118728:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118733:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.118738:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.119344:0:9159:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8d66459b9a00:9159] 2 exiting: rc = 0 00000100:00100000:2.0:1788684287.119361:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d6774820c00:6503] 1 exiting: rc = 0 00000100:00100000:1.0:1788684287.121115:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d6774821400:6502] 0 exiting: rc = 1 00000100:00100000:0.0:1788684287.122728:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122738:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122752:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122757:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122764:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122770:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122776:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122793:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122800:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122805:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122811:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122818:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122824:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122830:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122837:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122843:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122852:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122858:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122864:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122895:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122902:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122909:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122915:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122922:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122929:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122935:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122941:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122948:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122955:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122960:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122967:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122989:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.122997:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123002:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123009:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123015:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123022:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123028:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123034:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123041:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123048:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123054:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123060:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123081:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123089:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123096:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123102:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123109:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123116:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123123:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123128:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123134:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123139:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123144:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123157:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123177:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123184:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123190:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123196:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123202:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123207:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123213:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123218:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.123235:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684287.148244:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d678002d800:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1788684287.148245:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d678002c400:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1788684287.159840:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159849:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159855:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159860:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159865:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159869:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159874:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159878:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159883:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159888:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159893:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159899:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159904:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159909:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159914:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159919:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159924:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159929:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159934:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159939:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159944:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159949:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159954:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159959:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159963:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159983:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159988:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159993:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.159998:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160003:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160007:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160012:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160018:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160022:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160028:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160033:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160038:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160043:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160048:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160053:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160058:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160062:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160067:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160073:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160204:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160210:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160215:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160221:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160226:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160479:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160488:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160641:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160650:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160654:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160659:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160664:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160668:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160673:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160678:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160683:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160697:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160701:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160707:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.160712:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684287.161157:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d67571b5600:6506] 0 exiting: rc = 1 00000100:00100000:2.0:1788684287.161932:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d6743d7de00:6507] 1 exiting: rc = 0 00000100:00100000:0.0:1788684287.162135:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162142:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162146:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162151:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162157:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162162:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162167:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162172:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162177:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162182:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162187:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162192:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162197:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162202:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162207:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162212:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162217:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162222:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162226:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162230:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162235:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162241:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162246:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162251:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162256:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162260:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162264:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162269:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162274:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162279:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162283:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162298:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162303:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162307:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162312:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162316:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162321:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162326:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162331:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162337:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162341:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162346:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162351:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162356:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.162361:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164519:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164531:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164535:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164540:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164544:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164548:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164553:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164557:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164561:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164566:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164570:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164574:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164578:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164582:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164586:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164591:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164595:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164600:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.164604:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684287.167759:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d6743d7da00:6508] 0 exiting: rc = 1 00000100:00100000:2.0:1788684287.168324:0:6509:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d6743d7c600:6509] 1 exiting: rc = 0 00000100:00100000:0.0:1788684287.168420:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168426:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168440:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168444:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168449:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168454:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168459:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168463:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168467:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168472:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168476:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168481:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168486:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168490:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168495:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.168499:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169424:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169436:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169440:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169445:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169449:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169454:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169459:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169463:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169467:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169471:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169479:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169484:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169488:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169492:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169497:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169501:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169506:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169510:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169514:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169519:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169523:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169536:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169540:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169544:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169549:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169553:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169558:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169563:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169567:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169571:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169576:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169583:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169588:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169593:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169598:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169602:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169606:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169610:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169614:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169618:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169622:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169626:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169631:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169635:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169639:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169643:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169648:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.169653:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684287.172288:0:6510:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d67511b8200:6510] 0 exiting: rc = 1 00000100:00100000:2.0:1788684287.173413:0:6512:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d6742ff9800:6512] 2 exiting: rc = 0 00000100:00100000:0.0:1788684287.174182:0:6511:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d67511b9c00:6511] 1 exiting: rc = 0 00000100:00100000:0.0:1788684287.175042:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175056:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175062:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175067:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175073:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175079:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175085:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175103:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175108:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175114:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175121:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175126:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175132:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175137:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175143:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175148:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175153:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175159:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175165:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175170:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175177:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175183:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175188:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175207:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175214:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175219:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175225:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175677:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175686:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175691:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175696:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175702:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175706:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175712:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175717:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175722:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175727:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175732:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175738:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175743:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175748:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175753:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175766:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175771:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175776:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175782:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175787:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175805:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175810:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175815:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175820:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175825:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175830:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175834:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175839:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175844:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175848:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175853:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175858:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175862:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175867:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175871:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175876:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684287.175881:0:15382:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788684287.182906:0:15382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684287.182918:0:15382:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788684287.182922:0:15382:0:(genops.c:885:class_export_put()) final put ffff8d6758ee3800/MDS_uuid 00000020:00000080:0.0:1788684287.182926:0:15382:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6758ee3800/MDS_uuid for MDS 00000020:01000000:0.0:1788684287.182931:0:15382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788684287.183067:0:15382:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788684287.615301:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684288.639157:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684289.661679:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788684290.183092:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684290.183102:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684290.183106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684290.183109:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788684290.183129:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d678003d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684290.183137:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 366 00000100:00080000:0.0:1788684290.183142:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788684290.183149:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d678003d800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684290.183184:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648664380 x1875571085832960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684290.183247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684290.183250:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788684290.183252:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d664740b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684290.183256:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 366 00000100:00080000:0.0:1788684290.183258:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788684290.183262:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d664740b800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684290.183273:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648665880 x1875571085833216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684290.183314:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085832960:0@lo:38:kworker.0 00000400:00000100:0.0:1788684290.183390:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085832960 offset 0 length 520: 4 00000100:00100000:0.0:1788684290.183436:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085833216:0@lo:38:kworker.0 00000400:00000100:0.0:1788684290.183454:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085833216 offset 0 length 520: 4 00000100:00100000:0.0:1788684290.183487:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085833344:0@lo:400:kworker.0 00000400:00000100:0.0:1788684290.183504:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085833344 offset 0 length 224: 4 00000100:00100000:0.0:1788684290.183517:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684290.183522:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085833088:0@lo:400:kworker.0 00000400:00000100:0.0:1788684290.183537:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085833088 offset 0 length 224: 4 00010000:00010000:0.0:1788684290.690475:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788684291.204935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788684291.204948:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684291.204961:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788684291.204966:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684291.205052:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788684291.205056:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684291.205100:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085833600:0@lo:400:kworker.0 00000400:00000100:2.0:1788684291.205316:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085833600 offset 0 length 224: 4 00000100:00100000:2.0:1788684291.205414:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684291.205422:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085833472:0@lo:400:kworker.0 00000400:00000100:2.0:1788684291.205442:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085833472 offset 0 length 224: 4 00000020:01000004:3.0:1788684291.245790:0:15583:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788684291.267667:0:15583:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788684291.267739:0:15583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684291.267757:0:15583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684291.267765:0:15583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684291.267772:0:15583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684291.267792:0:15583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788684291.267798:0:15583:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788684291.267826:0:15583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684291.267839:0:15583:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6648664380 x1875571085832960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788684310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684291.267855:0:15583:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788684291.267898:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d678003d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684291.267903:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1788684291.267907:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085832960:0@lo:38:kworker.0 00000100:00080000:0.0:1788684291.267990:0:15583:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788684291.267996:0:15583:0:(import.c:65:import_set_state_nolock()) ffff8d678003d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788684291.268002:0:15583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684291.268004:0:15583:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788684291.268008:0:15583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788684291.268896:0:15583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788684291.268908:0:15583:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6648667b80 x1875571085833088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684306 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684291.268953:0:15583:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d664876ce00 x1875571085833472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684307 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684291.268964:0:15583:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788684291.268968:0:15583:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788684291.268997:0:15583:0:(import.c:65:import_set_state_nolock()) ffff8d678003c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788684291.269035:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085833728:0@lo:39:umount.0 00000400:00000100:0.0:1788684291.269095:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085833728 offset 0 length 224: 4 00000100:00100000:2.0:1788684291.269723:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085833472:0@lo:400:kworker.0 00010000:00010000:0.0:1788684291.269895:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684291.269906:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684291.269918:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6740030c00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684291.269922:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684291.269933:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684291.269941:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684291.269946:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788684291.269949:0:9499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788684291.270051:0:9499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788684291.270069:0:9499:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677487c800 00010000:00010000:0.0:1788684291.270073:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684291.270097:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6740030c00/0x44bac02bd54ac34c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac353 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684291.270178:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684291.270180:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684291.270182:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684291.270661:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085833088:0@lo:400:kworker.0 00010000:00010000:1.0:1788684291.710258:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684292.735243:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788684292.735397:0:9488:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788684292.735403:0:9488:0:(genops.c:885:class_export_put()) final put ffff8d677fa99000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788684292.736128:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fa99000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788684292.736183:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677fa9f800 for lustre-OST0001 00000001:00100000:0.0:1788684292.736472:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788684292.736477:0:8406:0:(genops.c:885:class_export_put()) final put ffff8d677f9b3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788684292.736537:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677f9b3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788684292.736572:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677f9b4800 for lustre-OST0000 00010000:00010000:0.0:1788684293.758609:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684294.782996:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788684295.229616:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684295.229627:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684295.229630:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684295.229634:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684295.229741:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684295.230046:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085833856:0@lo:400:kworker.0 00000400:00000100:2.0:1788684295.230099:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085833856 offset 0 length 224: 4 00010000:00010000:2.0:1788684295.806456:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684296.381535:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684286/real 1788684286] req@ffff8d66479a4000 x1875571085832576/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788684296 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684296.381570:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a4000 x1875571085832576/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788684296 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788684296.381592:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677487c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684296.381621:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788684296.381625:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3622:1875571085832576:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788684296.381722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684296.381727:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788684296.381730:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677487c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684296.381735:0:36:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 367 00000100:00080000:3.0:1788684296.381740:0:36:0:(import.c:630:import_select_connection()) MGC192.168.206.144@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788684296.381746:0:36:0:(import.c:665:import_select_connection()) MGC192.168.206.144@tcp: import ffff8d677487c800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684296.381777:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a5880 x1875571085833984/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684296.381802:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684296.381807:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684296.381923:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085834112:0@lo:400:kworker.0 00000400:00000100:2.0:1788684296.381971:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085834112 offset 0 length 224: 4 00000100:00100000:0.0:1788684296.382408:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3622:1875571085833984:0@lo:250:kworker.0 00000400:00000100:0.0:1788684296.382433:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875571085833984 offset 0 length 520: 4 00010000:00010000:0.0:1788684296.829628:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684297.854131:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684298.881399:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684299.901585:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684300.926025:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788684301.441180:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788684301.441193:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684301.441196:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788684301.441199:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684301.441429:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085834240:0@lo:400:kworker.0 00000400:00000100:2.0:1788684301.441498:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085834240 offset 0 length 224: 4 00000100:00100000:0.0:1788684301.501529:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684291/real 1788684291] req@ffff8d6648664380 x1875571085833728/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788684301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684301.501571:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d6648664380 x1875571085833728/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788684301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788684301.501703:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d678003c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788684301.501728:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085833728:0@lo:39:umount.0 00000100:00080000:3.0:1788684301.501836:0:15583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788684301.501842:0:15583:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788684301.501848:0:15583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788684301.503175:0:15583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684301.503197:0:15583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684301.503205:0:15583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684301.503213:0:15583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684301.503243:0:15583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684301.503250:0:15583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684301.503272:0:15583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684301.503278:0:15583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684301.503283:0:15583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684301.503310:0:15583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788684301.503314:0:15583:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788684301.503344:0:15583:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788684301.503349:0:15583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788684301.503353:0:15583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684301.503359:0:15583:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1788684301.503762:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684301.503771:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684301.503779:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711da00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684301.503783:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684301.503792:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684301.503800:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684301.503806:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788684301.503809:0:9499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788684301.503811:0:9499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788684301.503830:0:9499:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677487c800 00010000:00010000:0.0:1788684301.503834:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684301.503842:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ac35a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac361 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684301.503858:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684301.503861:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684301.503876:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684301.503879:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684301.503886:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684301.503892:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684301.503896:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788684301.503899:0:9499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788684301.503900:0:9499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788684301.503907:0:9499:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677487c800 00010000:00010000:0.0:1788684301.503910:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684301.503917:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ac5d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac5d7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684301.503926:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684301.503928:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684301.503930:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788684301.503983:0:15583:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d677cf28000) has no exports 00000020:00080000:3.0:1788684301.504017:0:15583:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d677cf28000) has no exports 00010000:00010000:2.0:1788684301.504573:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788684301.510204:0:15583:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6646ea2960 - data ffff8d67676e0438/ffff8d6647768c00 00000020:01000000:3.0:1788684301.511236:0:15583:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6743f9b1e0 - data ffff8d67676bca20/ffff8d664648b800 00100000:10000000:3.0:1788684301.517922:0:15583:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788684301.529244:0:15583:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac0ac 00000020:00000080:3.0:1788684301.529256:0:15583:0:(genops.c:885:class_export_put()) final put ffff8d6645993800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788684301.529272:0:15583:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d677e122800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788684301.529276:0:15583:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677e122800 2 00000020:01000004:3.0:1788684301.529279:0:15583:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d677e122800 from lustre-OST0000 00000020:00000080:3.0:1788684301.529315:0:15583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788684301.529325:0:15583:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788684301.529327:0:15583:0:(genops.c:885:class_export_put()) final put ffff8d6645994000/lustre-OST0000_UUID 00000020:00000080:3.0:1788684301.529330:0:15583:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6645994000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788684301.529348:0:15583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788684301.529423:0:15583:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788684301.529428:0:15583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788684301.529431:0:15583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684301.529436:0:15583:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788684301.529442:0:15583:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d6775f86800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788684301.529448:0:15583:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d6750b7cd40) has exports, disconnecting them 00000020:00080000:3.0:1788684301.529453:0:15583:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d6775f86800), last request at 1788684077 00000020:00000080:3.0:1788684301.529457:0:15583:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac0d6 00000020:00080000:3.0:1788684301.529465:0:15583:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6775f86800): rc 0 00000020:00000080:3.0:1788684301.529468:0:15583:0:(genops.c:885:class_export_put()) final put ffff8d6775f86800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788684301.530161:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6645993800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788684301.530189:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775f86800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788684301.534570:0:15583:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788684301.534579:0:15583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684301.534583:0:15583:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788684301.534590:0:15583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684301.534659:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d678003d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788684301.534813:0:15583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684301.534824:0:15583:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788684301.534844:0:15583:0:(genops.c:885:class_export_put()) final put ffff8d677cefa000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788684301.534849:0:15583:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cefa000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788684301.534867:0:15583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788684301.534936:0:15583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788684301.534940:0:15583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684301.534945:0:15583:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788684301.534951:0:15583:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d677ceff000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684301.534957:0:15583:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8d66465e4d40) has exports, disconnecting them 00000020:00080000:0.0:1788684301.534961:0:15583:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d677ceff000), last request at 1788684077 00000020:00000080:0.0:1788684301.534965:0:15583:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac0eb 00000020:00080000:0.0:1788684301.534979:0:15583:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d677ceff000): rc 0 00000020:00000080:0.0:1788684301.534983:0:15583:0:(genops.c:885:class_export_put()) final put ffff8d677ceff000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788684301.535022:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677ceff000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788684301.542918:0:15583:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788684301.542926:0:15583:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788684301.542946:0:15583:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788684301.542953:0:15583:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684301.542982:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d678003c000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788684301.543163:0:15583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684301.543172:0:15583:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788684301.543177:0:15583:0:(genops.c:885:class_export_put()) final put ffff8d6775f87000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788684301.543181:0:15583:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775f87000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788684301.543186:0:15583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788684301.543248:0:15583:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677e122800 1 00000020:00000080:1.0:1788684301.543255:0:15583:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac074 00000020:00000080:1.0:1788684301.543262:0:15583:0:(genops.c:885:class_export_put()) final put ffff8d677cf25800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788684301.543270:0:15583:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788684301.543278:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf25800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788684301.543287:0:15583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684301.543303:0:15583:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788684301.543307:0:15583:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d677e144d40) has no exports 00000020:00000080:1.0:1788684301.711554:0:15583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684301.711566:0:15583:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788684301.711572:0:15583:0:(genops.c:885:class_export_put()) final put ffff8d677e124800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788684301.711576:0:15583:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677e124800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788684301.711588:0:15583:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788684301.711688:0:15583:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d677e125000 00000020:02000400:1.0:1788684301.711728:0:15583:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788684301.950051:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684302.974027:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684303.997918:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684305.029920:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788684305.088591:0:15785:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788684305.103692:0:15785:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788684305.103770:0:15785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684305.103796:0:15785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684305.103804:0:15785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684305.103810:0:15785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684305.103831:0:15785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788684305.103837:0:15785:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788684305.103859:0:15785:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788684305.103869:0:15785:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6648665880 x1875571085833216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788684310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684305.103907:0:15785:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788684305.103913:0:15785:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788684305.103919:0:15785:0:(import.c:65:import_set_state_nolock()) ffff8d664740b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788684305.103924:0:15785:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788684305.103928:0:15785:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6648665880 x1875571085833216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788684310 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684305.103936:0:15785:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788684305.103939:0:15785:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:0.0:1788684305.103990:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684305.103997:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684305.104004:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477fee00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684305.104008:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684305.104016:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684305.104022:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684305.104028:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788684305.104030:0:9499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788684305.104038:0:9499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788684305.104052:0:9499:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677487c800 00010000:00010000:0.0:1788684305.104056:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684305.104063:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477fee00/0x44bac02bd54ac330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac337 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684305.104072:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684305.104074:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684305.104075:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684305.104290:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085833216:0@lo:38:kworker.0 00000100:00080000:3.0:1788684305.106473:0:15785:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788684305.106490:0:15785:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6648666680 x1875571085833344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684306 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684305.106520:0:15785:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d664876ed80 x1875571085833600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684307 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684305.106535:0:15785:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d66479a5500 x1875571085833856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684311 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684305.106543:0:15785:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d66479a5c00 x1875571085834112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684312 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684305.106551:0:15785:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fa72d80 x1875571085834240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684317 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684305.106563:0:15785:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788684305.106569:0:15785:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788684305.106593:0:15785:0:(import.c:65:import_set_state_nolock()) ffff8d677e50e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788684305.106751:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085834112:0@lo:400:kworker.0 00000100:00100000:0.0:1788684305.106753:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085833600:0@lo:400:kworker.0 00000100:00100000:2.0:1788684305.106759:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085833856:0@lo:400:kworker.0 00000100:00100000:2.0:1788684305.106765:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085833344:0@lo:400:kworker.0 00000100:00100000:1.0:1788684305.106896:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085834240:0@lo:400:kworker.0 00000100:00100000:1.0:1788684305.106920:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085834368:0@lo:39:umount.0 00000400:00000100:1.0:1788684305.106979:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085834368 offset 0 length 224: 4 00010000:00010000:1.0:1788684306.045795:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788684306.557616:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684306.557624:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788684307.070990:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684308.098492:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684309.117654:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684310.141648:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684311.168798:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684311.229804:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684296/real 1788684296] req@ffff8d66479a5880 x1875571085833984/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788684311 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684311.229848:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a5880 x1875571085833984/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788684311 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788684311.229873:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677487c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684311.232999:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788684311.233180:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3622:1875571085833984:0@lo:250:kworker.0 00000100:00080000:3.0:1788684311.233436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684311.233465:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788684311.233469:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677487c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684311.233475:0:36:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 377 00000100:00080000:3.0:1788684311.233482:0:36:0:(import.c:630:import_select_connection()) MGC192.168.206.144@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788684311.233492:0:36:0:(import.c:665:import_select_connection()) MGC192.168.206.144@tcp: import ffff8d677487c800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684311.233535:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a7b80 x1875571085834496/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684311.233642:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3622:1875571085834496:0@lo:250:kworker.0 00000400:00000100:2.0:1788684311.233712:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875571085834496 offset 0 length 520: 4 00010000:00010000:1.0:1788684312.189921:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684313.214598:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684314.241518:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684315.262066:0:6486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684315.326028:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684305/real 1788684305] req@ffff8d66479a7100 x1875571085834368/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788684315 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684315.326070:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a7100 x1875571085834368/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788684315 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788684315.326118:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677e50e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788684315.326144:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085834368:0@lo:39:umount.0 00000100:00080000:3.0:1788684315.326524:0:15785:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788684315.326532:0:15785:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788684315.326540:0:15785:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788684315.332653:0:15785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684315.332679:0:15785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684315.332688:0:15785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684315.332696:0:15785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684315.332731:0:15785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684315.332741:0:15785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684315.334480:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684315.334497:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684315.334510:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684315.334516:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684315.334527:0:6485:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684315.334535:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684315.334541:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788684315.334544:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788684315.334574:0:6485:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677487c800 00010000:00010000:2.0:1788684315.334578:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684315.334586:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711c400/0x44bac02bd54ac33e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac345 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684315.334611:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684315.334613:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684315.334615:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684315.334708:0:15785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684315.334729:0:15785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684315.334735:0:15785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684315.334772:0:15785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788684315.334779:0:15785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788684315.334784:0:15785:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788684315.334839:0:15785:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788684315.334845:0:15785:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788684315.334852:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684315.334859:0:15785:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788684315.334864:0:15785:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8d677e3ecd40) has no exports 00000020:00080000:3.0:1788684315.334895:0:15785:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8d677e3ecd40) has no exports 00010000:00010000:0.0:1788684315.335151:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684315.335159:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684315.335166:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684315.335170:0:9499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684315.335177:0:9499:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684315.335185:0:9499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684315.335191:0:9499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788684315.335201:0:9499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788684315.335203:0:9499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788684315.335212:0:9499:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677487c800 00010000:00010000:0.0:1788684315.335225:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684315.335231:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ac5c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac5c9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684315.335247:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684315.335250:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684315.335251:0:9499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788684315.344728:0:15785:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6743f9bf60 - data ffff8d6767737000/ffff8d6647769000 00000020:01000000:3.0:1788684315.346017:0:15785:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6645bc7a80 - data ffff8d6767745438/ffff8d677e4af800 00100000:10000000:3.0:1788684315.360046:0:15785:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788684315.367158:0:15785:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac1d2 00000020:00000080:0.0:1788684315.367175:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d6646d41000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788684315.367189:0:15785:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d67771bc800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788684315.367193:0:15785:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67771bc800 2 00000020:01000004:0.0:1788684315.367197:0:15785:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d67771bc800 from lustre-OST0001 00000020:00000080:3.0:1788684315.367237:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646d41000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788684315.367245:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684315.367257:0:15785:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788684315.367261:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d677f9b7000/lustre-OST0001_UUID 00000020:00000080:0.0:1788684315.367263:0:15785:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677f9b7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788684315.367271:0:15785:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788684315.367488:0:15785:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import eb0a8256-d625-4e80-aa6e-17b94cff8c50->MGS 00010000:00010000:0.0:1788684315.367507:0:15785:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d67560a6c00/0x44bac02bd54abf2b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54abf32 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684315.367523:0:15785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d67560a6c00/0x44bac02bd54abf2b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54abf32 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684315.367531:0:15785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788684315.367534:0:15785:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788684315.367537:0:15785:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788684315.367564:0:15785:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677487c800 00010000:00010000:0.0:1788684315.367570:0:15785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d67560a6c00/0x44bac02bd54abf2b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54abf32 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684315.367682:0:15785:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ac3a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684315.367692:0:15785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ac3a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684315.367698:0:15785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788684315.367700:0:15785:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788684315.367702:0:15785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788684315.367715:0:15785:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677487c800 00010000:00010000:1.0:1788684315.367717:0:15785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ac3a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ac3a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788684315.367746:0:15785:0:(import.c:65:import_set_state_nolock()) ffff8d677487c800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788684315.367751:0:15785:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788684315.367754:0:15785:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788684315.367756:0:15785:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788684315.367761:0:15785:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788684315.367772:0:15785:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d66479a7b80 x1875571085834496/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788684331 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788684315.367795:0:15785:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788684315.367798:0:15785:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1788684315.367908:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eb0a8256-d625-4e80-aa6e-17b94cff8c50:3622:1875571085834496:0@lo:250:kworker.0 10000000:01000000:1.0:1788684315.367971:0:15785:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788684315.367979:0:15785:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54abe28 00000020:00000080:1.0:1788684315.367994:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d6758ee3000/eb0a8256-d625-4e80-aa6e-17b94cff8c50 00000020:01000000:1.0:1788684315.368038:0:15785:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.144@tcp (flags='') 00000020:00000080:1.0:1788684315.368045:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684315.368051:0:15785:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.144@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684315.368066:0:15785:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8d67482e3380) has no exports 10000000:01000000:0.0:1788684315.368099:0:6495:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788684315.368164:0:15785:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.144@tcp: client import never connected 00000100:00080000:1.0:1788684315.368168:0:15785:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788684315.368170:0:15785:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788684315.368172:0:15785:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788684315.368177:0:15785:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788684315.368534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6758ee3000/eb0a8256-d625-4e80-aa6e-17b94cff8c50 for MGC192.168.206.144@tcp 00000020:00000080:1.0:1788684315.369010:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684315.369019:0:15785:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.144@tcp (uuid eb0a8256-d625-4e80-aa6e-17b94cff8c50) 00000020:01000000:1.0:1788684315.369027:0:15785:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788684315.369031:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684315.369036:0:15785:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788684315.369046:0:15785:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d664740b000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788684315.369052:0:15785:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8d6647430000) has exports, disconnecting them 00000020:00080000:1.0:1788684315.369057:0:15785:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d664740b000), last request at 1788684096 00000020:00000080:1.0:1788684315.369062:0:15785:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac1fc 00000020:00080000:1.0:1788684315.369082:0:15785:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d664740b000): rc 0 00000020:00000080:1.0:1788684315.369089:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d664740b000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788684315.370453:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677487c800 for MGC192.168.206.144@tcp 00000020:00000080:3.0:1788684315.370471:0:36:0:(genops.c:885:class_export_put()) final put ffff8d677487e000/eb0a8256-d625-4e80-aa6e-17b94cff8c50 00000020:00000080:3.0:1788684315.370474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677487e000/eb0a8256-d625-4e80-aa6e-17b94cff8c50 for MGC192.168.206.144@tcp 00000020:01000000:3.0:1788684315.370538:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.144@tcp (eb0a8256-d625-4e80-aa6e-17b94cff8c50) 00000020:00000080:3.0:1788684315.371072:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664740b000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788684315.373646:0:15785:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788684315.373657:0:15785:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684315.373719:0:15785:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788684315.373814:0:15785:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788684315.374099:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664740b800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788684315.374321:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684315.374331:0:15785:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788684315.374338:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d664740f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788684315.374342:0:15785:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664740f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788684315.374349:0:15785:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788684315.374526:0:15785:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788684315.374531:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684315.375676:0:15785:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788684315.375689:0:15785:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8d664740c000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684315.375696:0:15785:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8d6647434d40) has exports, disconnecting them 00000020:00080000:0.0:1788684315.375702:0:15785:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8d664740c000), last request at 1788684096 00000020:00000080:0.0:1788684315.375706:0:15785:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac211 00000020:00080000:0.0:1788684315.375810:0:15785:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d664740c000): rc 0 00000020:00000080:0.0:1788684315.375820:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d664740c000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788684315.376038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664740c000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788684315.384263:0:15785:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788684315.384275:0:15785:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788684315.384280:0:15785:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788684315.384289:0:15785:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788684315.384475:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677e50e000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788684315.384567:0:6486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788684315.384612:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788684315.385510:0:9499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788684315.385664:0:6481:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d6767a5e600:6481] 1 exiting: rc = 0 00000100:00100000:1.0:1788684315.385800:0:10374:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff8d6647792600:10374] 3 exiting: rc = 0 00000100:00100000:2.0:1788684315.386553:0:6480:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d6774822800:6480] 0 exiting: rc = 1 00000100:00100000:3.0:1788684315.386845:0:9498:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d6646dda600:9498] 2 exiting: rc = 0 00000100:00100000:1.0:1788684315.386930:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387271:0:6482:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d6774823200:6482] 0 exiting: rc = 1 00000100:00100000:2.0:1788684315.387311:0:6483:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d6774823000:6483] 1 exiting: rc = 0 00000100:00100000:3.0:1788684315.387348:0:6484:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d67565b3000:6484] 2 exiting: rc = 0 00000100:00100000:1.0:1788684315.387530:0:9510:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d6646774200:9510] 3 exiting: rc = 0 00000100:00100000:1.0:1788684315.387830:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387839:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387846:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387852:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387860:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387871:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387878:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387896:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387908:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387914:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387920:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387925:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387931:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387938:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387949:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387955:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387961:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387967:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387972:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387979:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387985:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387990:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.387996:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388002:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388008:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388014:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388019:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388024:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388030:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388041:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388047:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388053:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388058:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388064:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388070:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388076:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388082:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388087:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388094:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388100:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388105:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388110:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388122:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388128:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388134:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388139:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388144:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388150:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388155:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388161:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388166:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388171:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388176:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388181:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388186:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388191:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388196:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388201:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388207:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388212:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388228:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388234:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388240:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.388246:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788684315.389848:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684315.389863:0:15785:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788684315.389871:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d6647409800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788684315.389876:0:15785:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6647409800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788684315.389884:0:15785:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788684315.389952:0:15785:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67771bc800 1 00000020:00000080:1.0:1788684315.389960:0:15785:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ac1a1 00000020:00000080:1.0:1788684315.389968:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d664672c000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788684315.390039:0:15785:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788684315.390045:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684315.390050:0:15785:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788684315.390055:0:15785:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8d677e1419c0) has no exports 00000020:00000080:3.0:1788684315.390782:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664672c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788684315.421983:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684315.421998:0:15785:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788684315.422003:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d67771be800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788684315.422008:0:15785:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67771be800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788684315.422013:0:15785:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788684315.422465:0:15785:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d67771bb000 00000020:01000000:0.0:1788684315.422573:0:15785:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788684315.422577:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684315.422581:0:15785:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788684315.422585:0:15785:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8d677e143380) has no exports 00000020:00000080:0.0:1788684315.422615:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684315.422622:0:15785:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788684315.422625:0:15785:0:(genops.c:885:class_export_put()) final put ffff8d677cf20800/OSS_uuid 00000020:00000080:0.0:1788684315.422627:0:15785:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf20800/OSS_uuid for OSS 00000020:01000000:0.0:1788684315.422631:0:15785:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788684315.422806:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d677e2fd400:8413] 2 exiting: rc = 0 00000100:00100000:1.0:1788684315.422902:0:9991:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d66459b9200:9991] 3 exiting: rc = 0 00000100:00100000:2.0:1788684315.423042:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d6775ec4800:8412] 1 exiting: rc = 0 00000100:00080000:3.0:1788684315.423193:0:6492:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788684315.423320:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d6742cdbe00:8411] 0 exiting: rc = 1 00000100:00100000:0.0:1788684315.423687:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423695:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423701:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423714:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423720:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423726:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423731:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423736:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423740:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423745:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423750:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423755:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423760:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423765:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423770:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423775:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423780:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423785:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423790:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423801:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423807:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423813:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423819:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423824:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423829:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423834:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423850:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423855:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423860:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423866:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423871:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423875:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423880:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423884:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423888:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423893:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423897:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423902:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423907:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423913:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423918:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423923:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423928:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423933:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423938:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423949:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423956:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423961:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423970:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423980:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423985:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423990:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.423995:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424000:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424005:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424010:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424016:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424021:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424027:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424032:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424036:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424049:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424054:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.424063:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.425675:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d677e2ffe00:8414] 0 exiting: rc = 1 00000100:00100000:0.0:1788684315.425815:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d677e2fe600:8415] 1 exiting: rc = 0 00000100:00100000:3.0:1788684315.425895:0:14146:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8d66477bca00:14146] 2 exiting: rc = 0 00000100:00100000:1.0:1788684315.426008:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426016:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426023:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426027:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426032:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426037:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426043:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426048:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426053:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426059:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426065:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426071:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426076:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426152:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426159:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426164:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426170:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426175:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426181:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426186:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426191:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426196:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426202:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426206:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426212:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426228:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426233:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426239:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426245:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426250:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426254:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426259:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426264:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426281:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426287:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426292:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426297:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426303:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426308:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426313:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426318:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426324:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426328:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426334:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426339:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426344:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426349:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426354:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426359:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426778:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426786:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426791:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426795:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426801:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426806:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426810:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426815:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426820:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426824:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426829:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426834:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426839:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426843:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.426848:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.428167:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d677e2fc400:8416] 0 exiting: rc = 1 00000100:00100000:1.0:1788684315.428612:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d67801a0000:8417] 1 exiting: rc = 0 00000100:00100000:2.0:1788684315.428959:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d67800b2000:8418] 2 exiting: rc = 0 00000100:00100000:1.0:1788684315.429315:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429324:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429329:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429346:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429351:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429356:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429362:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429585:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429590:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429596:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429602:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429608:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429613:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429619:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429624:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429630:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429636:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429642:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429647:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429653:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429658:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429664:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429669:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429676:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429681:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429701:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429708:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429714:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429719:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429725:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429730:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429736:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429741:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429747:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429753:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429758:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429763:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429768:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429782:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429788:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429794:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429800:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429806:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429812:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429818:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429835:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429842:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429847:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429853:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429872:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429879:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429885:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429891:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429896:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429901:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429907:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429913:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429927:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429934:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429940:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429952:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429959:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429966:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684315.429972:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.434947:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d677e295400:8419] 0 exiting: rc = 1 00000100:00100000:0.0:1788684315.435142:0:8420:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d677e294800:8420] 1 exiting: rc = 0 00000100:00100000:2.0:1788684315.435250:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435258:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435263:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435267:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435272:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435278:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435282:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435287:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435291:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435296:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435301:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435305:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435316:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435322:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435327:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435332:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435337:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435343:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435348:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435352:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435357:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435391:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435398:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435403:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435407:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435412:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435417:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435422:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435441:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435447:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435452:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435456:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435461:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435466:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435471:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435488:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435492:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435497:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435502:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435507:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435512:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435517:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435522:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435527:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435532:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435538:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435542:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435548:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435553:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435558:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435563:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435568:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435573:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435578:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435583:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435588:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435594:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435599:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435604:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435609:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435613:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435617:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435622:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.435634:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684315.436458:0:8421:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d677482d800:8421] 0 exiting: rc = 1 00000100:00100000:3.0:1788684315.436767:0:8422:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d678002da00:8422] 1 exiting: rc = 0 00000100:00100000:2.0:1788684315.436891:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436914:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436922:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436927:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436934:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436940:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436946:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436953:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436960:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436967:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436974:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436980:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.436987:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437009:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437017:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437023:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437029:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437037:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437044:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437050:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437057:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437064:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437071:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437145:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437155:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437179:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437188:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437195:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437201:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437207:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437212:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437229:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437235:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437240:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437256:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437262:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437268:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437289:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437295:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437301:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437307:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437313:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437318:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437324:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437329:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437335:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437340:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437345:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437350:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437869:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437878:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437884:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437890:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437896:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437903:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437908:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437915:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437921:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437927:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437932:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437937:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437943:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437948:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684315.437961:0:15785:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788684315.446247:0:15785:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788684333.100668:0:16551:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788684343.845926:0:17150:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788684343.846454:0:17150:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788684343.846456:0:17150:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788684343.846563:0:17150:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d66484cb800 00000020:01000004:3.0:1788684343.846948:0:17150:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788684343.846957:0:17150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788684343.846972:0:17150:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d677721b380) 00000020:00000080:3.0:1788684343.846985:0:17150:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788684343.983968:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788684343.988767:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788684343.991049:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788684343.994238:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788684343.994882:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788684343.995154:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788684343.995431:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788684343.995774:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788684343.995973:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788684343.996176:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788684343.996514:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788684343.996807:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788684343.997031:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788684343.997251:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788684343.998089:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788684343.998299:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788684343.998760:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788684343.998949:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788684343.999184:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788684343.999467:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788684343.999797:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788684344.000016:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788684344.000238:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788684344.000508:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788684344.000833:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788684344.001231:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788684344.001723:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788684344.002012:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788684344.002243:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788684344.002502:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788684344.002808:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788684344.003020:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788684344.003254:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788684344.003553:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788684344.003913:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788684344.004997:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.005224:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788684344.005613:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.005950:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.006174:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788684344.006388:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788684344.006722:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.006917:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788684344.013009:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788684344.013427:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.013783:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.014018:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788684344.014550:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.014981:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.017838:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.019150:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.019474:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788684344.021335:0:17150:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1788684344.024078:0:17150:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788684344.024326:0:17150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788684344.024334:0:17150:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788684344.024346:0:17150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ad3e5 00000020:01000004:2.0:1788684344.024353:0:17150:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788684344.024386:0:17150:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788684344.024392:0:17150:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d66484cb800 from MGS 00000020:01000004:2.0:1788684344.024396:0:17150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788684344.024406:0:17150:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d6647433380) 00000020:00000080:2.0:1788684344.024416:0:17150:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788684344.024475:0:17150:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d66484cb800 from MGS, refs=2 00080000:01000000:2.0:1788684344.024479:0:17150:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788684344.024484:0:17150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ad3f3 00000100:00100000:2.0:1788684344.024704:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788684344.024829:0:17150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788684344.024836:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788684344.026076:0:17150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788684344.026085:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788684344.027793:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788684344.027968:0:17150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788684344.027974:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788684344.028696:0:17150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788684344.028705:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788684344.032109:0:17150:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788684344.032121:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788684344.039909:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684344.039916:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684344.039919:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684344.042200:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684344.042205:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684344.042207:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684344.044680:0:17150:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788684344.045560:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788684344.049294:0:17150:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788684344.050482:0:17162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788684344.050536:0:17150:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788684344.050569:0:17150:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788684344.051231:0:17150:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788684344.051533:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788684344.051683:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788684344.051689:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788684344.053111:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788684344.053119:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788684344.053731:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788684344.053738:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788684344.057091:0:17150:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788684344.057111:0:17150:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.144@tcp' 00000020:01000004:1.0:1788684344.057113:0:17150:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788684344.057140:0:17150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.144@tcp (typ=mgc) 00000020:00000080:1.0:1788684344.057152:0:17150:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.144@tcp (ffff8d677e3eb380) 00000020:00000080:1.0:1788684344.057177:0:17150:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788684344.057257:0:17150:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677fc82000@MGC192.168.206.144@tcp: add connection 192.168.206.144@tcp at head 00000100:00080000:2.0:1788684344.057531:0:17166:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1788684344.057802:0:17150:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.144@tcp-0 is initialized 00000040:01000000:1.0:1788684344.057810:0:17150:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788684344.063883:0:17168:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788684344.063977:0:17150:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.144@tcp (uuid c986901f-6089-4802-a23d-1179db951431) 00000020:00000080:2.0:1788684344.063999:0:17150:0:(genops.c:1385:class_connect()) connect: client c986901f-6089-4802-a23d-1179db951431, cookie 0x44bac02bd54ad401 00000100:00080000:2.0:1788684344.064010:0:17150:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684344.064016:0:17150:0:(import.c:665:import_select_connection()) MGC192.168.206.144@tcp: import ffff8d677fc82000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684344.064047:0:17150:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876ce00 x1875571085834624/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684344.064086:0:17150:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c986901f-6089-4802-a23d-1179db951431->MGS 00000020:01000004:2.0:1788684344.064108:0:17150:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788684344.064112:0:17150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788684344.064125:0:17150:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d66474319c0) 00000020:00000080:2.0:1788684344.064135:0:17150:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788684344.066325:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c986901f-6089-4802-a23d-1179db951431:3622:1875571085834624:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788684344.066406:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684344.067707:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085834624 00000100:00100000:3.0:1788684344.067724:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085834624 00000100:00100000:3.0:1788684344.067753:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684344.067761:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3622:x1875571085834624:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788684344.067783:0:17163:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c986901f-6089-4802-a23d-1179db951431@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:3.0:1788684344.067808:0:17163:0:(genops.c:1385:class_connect()) connect: client c986901f-6089-4802-a23d-1179db951431, cookie 0x44bac02bd54ad40f 00000100:00080000:3.0:1788684344.067921:0:17163:0:(import.c:65:import_set_state_nolock()) ffff8d677e50f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684344.067989:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+5:3622:x1875571085834624:12345-0@lo:250:mount.lustre.0 Request processed in 228us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.067997:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684344.068044:0:3622:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788684344.068053:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.144@tcp: connect to target with instance 0 00000100:00080000:3.0:1788684344.068071:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788684344.068077:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788684344.068081:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677fc82000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788684344.068083:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788684344.068096:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788684344.068101:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c986901f-6089-4802-a23d-1179db951431:3622:1875571085834624:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788684344.079708:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788684344.080662:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788684344.080670:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788684344.081501:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788684344.081510:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788684344.082069:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788684344.082077:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788684344.083024:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788684344.083206:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788684344.083211:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788684344.084103:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788684344.084110:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788684344.121126:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684344.121317:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788684344.121325:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788684344.122278:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788684344.122287:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788684344.122894:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684344.123036:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788684344.123040:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788684344.123440:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788684344.123446:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788684344.123975:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684344.124109:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788684344.124114:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788684344.124536:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788684344.124543:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788684344.125096:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684344.125230:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788684344.125235:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788684344.125701:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788684344.125708:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788684344.149202:0:17150:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788684344.149516:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788684344.149522:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788684344.151107:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788684344.151119:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788684344.151912:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788684344.151921:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788684344.154334:0:17150:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788684344.154394:0:17150:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788684344.154401:0:17150:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788684344.154494:0:17150:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788684344.154528:0:17150:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788684344.154532:0:17150:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788684344.154534:0:17150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684344.154535:0:17150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684344.154536:0:17150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684344.154537:0:17150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684344.154538:0:17150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684344.154540:0:17150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684344.154541:0:17150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684344.154543:0:17150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684344.154544:0:17150:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788684344.154546:0:17150:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788684344.154548:0:17150:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684344.154550:0:17150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684344.154551:0:17150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684344.154552:0:17150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684344.154553:0:17150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684344.154554:0:17150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684344.154555:0:17150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684344.154556:0:17150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684344.154557:0:17150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684344.154558:0:17150:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788684344.154592:0:17150:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788684344.154611:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085834752:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788684344.154675:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684344.154829:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085834752 00000100:00100000:1.0:1788684344.154836:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085834752 00000100:00100000:1.0:1788684344.154876:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684344.154884:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+5:17150:x1875571085834752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788684344.154927:0:17165:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788684344.154929:0:17165:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788684344.154932:0:17165:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:3.0:1788684344.155086:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001cc0 going to sleep for 11 seconds 10000000:01000000:1.0:1788684344.155708:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788684344.156341:0:17165:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788684344.160077:0:17188:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788684344.160086:0:17188:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788684344.160089:0:17188:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788684344.160092:0:17188:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788684344.160353:0:17188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788684344.160659:0:17165:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788684344.160675:0:17165:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788684344.162810:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+5:17150:x1875571085834752:12345-0@lo:253:mount.lustre.0 Request processed in 7920us (8127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684344.162823:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684344.162901:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085834752:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788684344.162917:0:17150:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788684344.162920:0:17150:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684344.162922:0:17150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684344.162923:0:17150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684344.162925:0:17150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684344.162936:0:17150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684344.162937:0:17150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684344.162939:0:17150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684344.162940:0:17150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684344.162942:0:17150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684344.162943:0:17150:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788684344.162962:0:17150:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d66484cb800 from lustre-MDT0000 10000000:01000000:3.0:1788684344.162992:0:17150:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788684344.162996:0:17150:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788684344.163000:0:17150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d677e3eb380 10000000:01000000:3.0:1788684344.163004:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788684344.163012:0:17150:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d677e3eb380 from 1 10000000:01000000:3.0:1788684344.163014:0:17150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788684344.163048:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.163058:0:17150:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.163079:0:17150:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684344.163099:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085834880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684344.163153:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684344.163225:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001300 going to sleep for 11 seconds 00000100:00100000:1.0:1788684344.163615:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085834880 00000100:00100000:1.0:1788684344.163622:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085834880 00000100:00100000:1.0:1788684344.163664:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684344.163673:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+5:17150:x1875571085834880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684344.163685:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684344.163699:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477b1800/0x44bac02bd54ad41d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad416 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684344.163720:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b1800/0x44bac02bd54ad41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad416 expref: 6 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684344.163731:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477b1800/0x44bac02bd54ad41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad416 expref: 6 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684344.163739:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1800, rc 0) 00000100:00100000:1.0:1788684344.163777:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+6:17150:x1875571085834880:12345-0@lo:101:mount.lustre.0 Request processed in 106us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684344.163783:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684344.163877:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085834880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684344.163896:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.163905:0:17150:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684344.163965:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684344.163991:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684344.164013:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001300 going to sleep for 11 seconds 00000100:00100000:1.0:1788684344.164112:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085835008 00000100:00100000:1.0:1788684344.164117:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085835008 00000100:00100000:1.0:1788684344.164150:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788684344.164155:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+6:17150:x1875571085835008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684344.164282:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+6:17150:x1875571085835008:12345-0@lo:501:mount.lustre.0 Request processed in 126us (290us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788684344.164288:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684344.164559:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835008:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788684344.164587:0:17150:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788684344.164637:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.164646:0:17150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684344.164654:0:17150:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d66484cb800 10000000:01000000:0.0:1788684344.164661:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788684344.164666:0:17150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d66484cb800 10000000:01000000:0.0:1788684344.164668:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788684344.164671:0:17150:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d66484cb800 from 1 10000000:01000000:0.0:1788684344.164674:0:17150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788684344.164694:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.164706:0:17150:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.164727:0:17150:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684344.164741:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684344.164771:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.164796:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11300 going to sleep for 11 seconds 00000100:00100000:3.0:1788684344.164835:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085835136 00000100:00100000:3.0:1788684344.164840:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085835136 00000100:00100000:3.0:1788684344.164874:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788684344.164881:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+6:17150:x1875571085835136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684344.164888:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684344.164899:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711de00/0x44bac02bd54ad42b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad424 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.164920:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711de00/0x44bac02bd54ad42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad424 expref: 7 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.164929:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711de00/0x44bac02bd54ad42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad424 expref: 7 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.164936:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711de00, rc 0) 00000100:00100000:3.0:1788684344.165059:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+7:17150:x1875571085835136:12345-0@lo:101:mount.lustre.0 Request processed in 178us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.165078:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684344.165083:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684344.165093:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.165101:0:17150:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684344.165114:0:17150:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788684344.165122:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.165129:0:17150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684344.165136:0:17150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788684344.165139:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684344.165143:0:17150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d66484cb800 10000000:01000000:0.0:1788684344.165146:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788684344.165149:0:17150:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788684344.165151:0:17150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788684344.165164:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.165177:0:17150:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.165184:0:17150:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684344.165197:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684344.165222:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.165246:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11300 going to sleep for 11 seconds 00000100:00100000:3.0:1788684344.165297:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085835264 00000100:00100000:3.0:1788684344.165307:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085835264 00000100:00100000:3.0:1788684344.165502:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684344.165510:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+7:17150:x1875571085835264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684344.165517:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684344.165525:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711c000/0x44bac02bd54ad439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad432 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.165538:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711c000/0x44bac02bd54ad439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad432 expref: 8 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.165545:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711c000/0x44bac02bd54ad439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad432 expref: 8 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.165551:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c000, rc 0) 00000100:00100000:3.0:1788684344.165588:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+8:17150:x1875571085835264:12345-0@lo:101:mount.lustre.0 Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.165594:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788684344.165654:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684344.165665:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.165673:0:17150:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684344.165722:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684344.165746:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.167216:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11300 going to sleep for 11 seconds 00000100:00100000:1.0:1788684344.167652:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085835392 00000100:00100000:1.0:1788684344.167661:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085835392 00000100:00100000:1.0:1788684344.167705:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788684344.167715:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+8:17150:x1875571085835392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684344.167870:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+9:17150:x1875571085835392:12345-0@lo:501:mount.lustre.0 Request processed in 156us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684344.167877:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684344.167982:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684344.168043:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684344.168095:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.168126:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11300 going to sleep for 11 seconds 00000100:00100000:1.0:1788684344.168234:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085835520 00000100:00100000:1.0:1788684344.168239:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085835520 00000100:00100000:1.0:1788684344.168258:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788684344.168264:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+9:17150:x1875571085835520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684344.169673:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+9:17150:x1875571085835520:12345-0@lo:503:mount.lustre.0 Request processed in 1404us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684344.169684:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684344.169783:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085835520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684344.170630:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17189:1875571085835648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684344.170690:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.170729:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11180 going to sleep for 11 seconds 00000100:00100000:2.0:1788684344.170782:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085835648 00000100:00100000:2.0:1788684344.170788:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085835648 00000100:00100000:2.0:1788684344.170831:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788684344.170840:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+9:17189:x1875571085835648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684344.171482:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+9:17189:x1875571085835648:12345-0@lo:502:llog_process_th.0 Request processed in 642us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684344.171490:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684344.171758:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17189:1875571085835648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684344.171785:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684344.171795:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.171798:0:17189:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788684344.171803:0:17189:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788684344.171807:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788684344.171819:0:17189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d66465e3380) 00000020:00000080:0.0:1788684344.171834:0:17189:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788684344.171841:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788684344.171919:0:17189:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788684344.171926:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ad447 00000020:00000080:0.0:1788684344.172718:0:17189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788684344.172725:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684344.172730:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.172731:0:17189:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788684344.172735:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684344.172739:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.172740:0:17189:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788684344.172743:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788684344.172753:0:17189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d66465e19c0) 00000020:00000080:0.0:1788684344.172764:0:17189:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788684344.172769:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788684344.172771:0:17189:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788684344.172774:0:17189:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788684344.172779:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788684344.172827:0:17189:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d66484cb800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788684344.172839:0:17189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d66465e0000) 00000020:00000080:0.0:1788684344.172846:0:17189:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788684344.172892:0:17189:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788684344.172904:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ad45c 00000020:00000080:0.0:1788684344.173147:0:17189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788684344.173153:0:17189:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788684344.173157:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x44bac02bd54ad463 00080000:01000000:0.0:1788684344.173162:0:17189:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788684344.173166:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ad46a 00010000:00010000:0.0:1788684344.237003:0:17189:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788684344.237666:0:17189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:0.0:1788684344.237968:0:17189:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788684344.238482:0:17189:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d66465e4d40) 00000020:00000080:0.0:1788684344.238498:0:17189:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788684344.238587:0:17189:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788684344.238594:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ad478 00000020:00000080:0.0:1788684344.239350:0:17189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788684344.250567:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x44bac02bd54ad47f 00000020:00000080:1.0:1788684344.250969:0:17189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788684344.250982:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684344.250988:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684344.250990:0:17189:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788684344.250993:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788684344.250996:0:17189:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788684344.250997:0:17189:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788684344.250999:0:17189:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788684344.251000:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788684344.251003:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684344.251004:0:17189:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788684344.251007:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684344.251011:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684344.251012:0:17189:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788684344.251016:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788684344.251055:0:17189:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788684344.251081:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684344.251084:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684344.251085:0:17189:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788684344.251088:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684344.251092:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684344.251093:0:17189:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788684344.251096:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788684344.251102:0:17189:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:1.0:1788684344.251131:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788684344.251145:0:17189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d677e3e99c0) 00000020:00000080:1.0:1788684344.251158:0:17189:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788684344.251163:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788684344.251213:0:17189:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788684344.251217:0:17189:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788684344.251223:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ad48d 00010000:00080000:1.0:1788684344.251252:0:17189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677487b000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1788684344.252879:0:17189:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788684344.260830:0:17189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788684344.260845:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788684344.260888:0:17189:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788684344.260907:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ad494 00000100:00080000:2.0:1788684344.260917:0:17189:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684344.260923:0:17189:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d677487b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684344.260968:0:17189:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876ce00 x1875571085835776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684344.261002:0:17189:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788684344.261059:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684344.261073:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684344.261075:0:17189:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788684344.261078:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788684344.261081:0:17189:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788684344.261083:0:17189:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684344.261084:0:17189:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684344.261087:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788684344.261089:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684344.261091:0:17189:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788684344.261095:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788684344.261100:0:17189:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788684344.261104:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684344.261106:0:17189:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788684344.261109:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788684344.261113:0:17189:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:2.0:1788684344.261139:0:17189:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788684344.261142:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684344.261156:0:17189:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d6647434d40) 00000020:00000080:2.0:1788684344.261167:0:17189:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788684344.261172:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788684344.261229:0:17189:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788684344.261236:0:17189:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788684344.261242:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ad4a2 00010000:00080000:2.0:1788684344.261270:0:17189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677cf21800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684344.261488:0:17189:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788684344.262009:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085835776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788684344.262085:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.262176:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085835776 00000100:00100000:0.0:1788684344.262184:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085835776 00000100:00100000:0.0:1788684344.262222:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684344.262230:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085835776:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788684344.262245:0:17176:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788684344.271141:0:17189:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788684344.272308:0:17189:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788684344.283559:0:17189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684344.284087:0:17189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788684344.295668:0:17189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788684344.296343:0:17195:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788684344.296353:0:17195:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788684344.297211:0:17189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788684344.297222:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788684344.297256:0:17189:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788684344.297271:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ad4a9 00000100:00080000:2.0:1788684344.297281:0:17189:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684344.297287:0:17189:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d677cf21800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684344.297321:0:17189:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876ea00 x1875571085835904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684344.297347:0:17189:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788684344.297415:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684344.297418:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684344.297420:0:17189:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788684344.297423:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788684344.297425:0:17189:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788684344.297427:0:17189:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684344.297428:0:17189:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684344.297430:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788684344.297432:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684344.297433:0:17189:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788684344.297435:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788684344.297438:0:17189:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788684344.297441:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684344.297442:0:17189:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788684344.297444:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788684344.297447:0:17189:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:2.0:1788684344.297467:0:17189:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788684344.297469:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684344.297478:0:17189:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d6647430000) 00000020:00000080:2.0:1788684344.297488:0:17189:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788684344.297491:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788684344.297553:0:17189:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788684344.297558:0:17189:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788684344.297563:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54ad4b7 00010000:00080000:2.0:1788684344.297596:0:17189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677cf25000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684344.297771:0:17189:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788684344.297827:0:17189:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788684344.297840:0:17189:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788684344.298804:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085835776:12345-0@lo:38:llog_process_th.0 Request processed in 36570us (36716us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788684344.298826:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684344.298980:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085835904:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788684344.299012:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085835904 offset 0 length 520: 4 00000100:00080000:3.0:1788684344.299052:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684344.299056:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788684344.299070:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085835776:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788684344.300630:0:17189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684344.305007:0:17189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788684344.305230:0:17189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788684344.305749:0:17197:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788684344.305759:0:17197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788684344.312482:0:17189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788684344.312498:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788684344.312544:0:17189:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788684344.312563:0:17189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ad4be 00000100:00080000:3.0:1788684344.312573:0:17189:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684344.312579:0:17189:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d677cf25000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684344.312612:0:17189:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a7b80 x1875571085836032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684344.312686:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085836032:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788684344.312757:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085836032 offset 0 length 520: 4 00000100:00080000:3.0:1788684344.312814:0:17189:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788684344.312868:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684344.312873:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684344.312875:0:17189:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788684344.312878:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684344.312882:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684344.312883:0:17189:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684344.312886:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684344.312888:0:17189:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788684344.312890:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684344.312892:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684344.312893:0:17189:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788684344.312895:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684344.312897:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684344.312898:0:17189:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788684344.312901:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788684344.312938:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17189:1875571085836160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684344.313092:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684344.313109:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67490016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684344.313270:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085836160 00000100:00100000:2.0:1788684344.313278:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085836160 00000100:00100000:2.0:1788684344.313322:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684344.313332:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+9:17189:x1875571085836160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684344.313478:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+9:17189:x1875571085836160:12345-0@lo:502:llog_process_th.0 Request processed in 147us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684344.313485:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684344.313702:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17189:1875571085836160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788684344.313728:0:17189:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684344.313738:0:17189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684344.313740:0:17189:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788684344.313744:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788684344.313895:0:17150:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788684344.313917:0:17150:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788684344.313943:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.313954:0:17150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684344.313973:0:17150:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d66484cb800 from 1 10000000:01000000:0.0:1788684344.313976:0:17150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684344.314002:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.314016:0:17150:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.314025:0:17150:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684344.314041:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684344.314085:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.314111:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684344.314131:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085836288 00000100:00100000:0.0:1788684344.314135:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085836288 00000100:00100000:0.0:1788684344.314161:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684344.314167:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+9:17150:x1875571085836288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684344.314175:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684344.314187:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad4c5 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.314208:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad4c5 expref: 10 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.314218:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad4c5 expref: 10 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.314226:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891e00, rc 0) 00000100:00100000:0.0:1788684344.314255:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+10:17150:x1875571085836288:12345-0@lo:101:mount.lustre.0 Request processed in 88us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684344.314261:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684344.314301:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684344.314315:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.314323:0:17150:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684344.314875:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836416:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788684344.314913:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.314937:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684344.314957:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085836416 00000100:00100000:0.0:1788684344.314961:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085836416 00000100:00100000:0.0:1788684344.314982:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684344.314987:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+10:17150:x1875571085836416:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788684344.315000:0:17165:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788684344.315005:0:17165:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788684344.315072:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+10:17150:x1875571085836416:12345-0@lo:256:mount.lustre.0 Request processed in 72us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684344.315079:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684344.315121:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836416:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788684344.315675:0:17150:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684344.315684:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.315694:0:17150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684344.315736:0:17150:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d66484cb800 from 1 10000000:01000000:0.0:1788684344.315738:0:17150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684344.315761:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.315767:0:17150:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.315776:0:17150:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684344.315789:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684344.315821:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.315846:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684344.315862:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085836544 00000100:00100000:0.0:1788684344.315866:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085836544 00000100:00100000:0.0:1788684344.315891:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684344.315898:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+10:17150:x1875571085836544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684344.315907:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684344.315917:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad4d3 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.315934:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad4d3 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.315943:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad4d3 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.315962:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890e00, rc 0) 00000100:00100000:0.0:1788684344.315992:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+11:17150:x1875571085836544:12345-0@lo:101:mount.lustre.0 Request processed in 94us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684344.315997:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684344.316032:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684344.316044:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.316052:0:17150:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684344.316119:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684344.316145:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.316158:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684344.316170:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085836672 00000100:00100000:0.0:1788684344.316173:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085836672 00000100:00100000:0.0:1788684344.316193:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788684344.316199:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+11:17150:x1875571085836672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684344.316316:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+11:17150:x1875571085836672:12345-0@lo:501:mount.lustre.0 Request processed in 116us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684344.316323:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788684344.316354:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684344.316418:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684344.316454:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.316479:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684344.316492:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085836800 00000100:00100000:0.0:1788684344.316495:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085836800 00000100:00100000:0.0:1788684344.316515:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684344.316520:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+11:17150:x1875571085836800:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684344.316594:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+11:17150:x1875571085836800:12345-0@lo:503:mount.lustre.0 Request processed in 72us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684344.316601:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684344.316640:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085836800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684344.317651:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17199:1875571085836928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684344.317703:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684344.317764:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684344.317792:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085836928 00000100:00100000:0.0:1788684344.317797:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085836928 00000100:00100000:0.0:1788684344.317873:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788684344.317882:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+11:17199:x1875571085836928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684344.319122:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+11:17199:x1875571085836928:12345-0@lo:502:llog_process_th.0 Request processed in 1236us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.319132:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788684344.319254:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17199:1875571085836928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684344.319285:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684344.319295:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.319298:0:17199:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788684344.319306:0:17199:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d66484cb800 00000020:00000080:0.0:1788684344.319309:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684344.319317:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684344.319319:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.319321:0:17199:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788684344.319323:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684344.319326:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.319327:0:17199:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788684344.319330:0:17199:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d66484cb800 00000020:00000080:0.0:1788684344.319332:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684344.319548:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684344.319559:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.319561:0:17199:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788684344.319564:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684344.319567:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.319568:0:17199:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684344.319572:0:17199:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d66484cb800 00000020:00000080:0.0:1788684344.319575:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684344.320099:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684344.320104:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.320105:0:17199:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684344.320108:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684344.320111:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.320112:0:17199:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788684344.320116:0:17199:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d66484cb800 00000020:00000080:0.0:1788684344.320118:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788684344.320170:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17199:1875571085837056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684344.320224:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.320307:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684344.328156:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085837056 00000100:00100000:1.0:1788684344.328171:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085837056 00000100:00100000:1.0:1788684344.328229:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684344.328239:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+11:17199:x1875571085837056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788684344.328413:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+11:17199:x1875571085837056:12345-0@lo:502:llog_process_th.0 Request processed in 175us (8188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684344.328427:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684344.330171:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17199:1875571085837056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788684344.330209:0:17199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684344.330217:0:17199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684344.330219:0:17199:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788684344.330224:0:17199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788684344.330291:0:17150:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788684344.330312:0:17150:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684344.330335:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.330346:0:17150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684344.330425:0:17150:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788684344.330429:0:17150:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d66484cb800 10000000:01000000:0.0:1788684344.330432:0:17150:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d66484cb800 10000000:01000000:0.0:1788684344.330436:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684344.330441:0:17150:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d66484cb800 from 1 10000000:01000000:0.0:1788684344.330444:0:17150:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788684344.330473:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.330482:0:17150:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.330491:0:17150:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684344.330510:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085837184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684344.330559:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.330590:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788684344.331069:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085837184 00000100:00100000:3.0:1788684344.331077:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085837184 00000100:00100000:3.0:1788684344.331115:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788684344.331123:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+11:17150:x1875571085837184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684344.331135:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684344.331147:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711d600/0x44bac02bd54ad4e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad4e1 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.331169:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711d600/0x44bac02bd54ad4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad4e1 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.331179:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711d600/0x44bac02bd54ad4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad4e1 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.331187:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d600, rc 0) 00000100:00100000:3.0:1788684344.331234:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+12:17150:x1875571085837184:12345-0@lo:101:mount.lustre.0 Request processed in 111us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.331240:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788684344.333569:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085837184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684344.333598:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684344.333610:0:17150:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684344.333697:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085837312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684344.333752:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684344.333798:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788684344.335602:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085837312 00000100:00100000:3.0:1788684344.335612:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085837312 00000100:00100000:3.0:1788684344.335672:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788684344.335681:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+12:17150:x1875571085837312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684344.335822:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+12:17150:x1875571085837312:12345-0@lo:501:mount.lustre.0 Request processed in 141us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.335829:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684344.336443:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085837312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684344.336491:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085837440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788684344.336542:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684344.336573:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742f9d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788684344.336635:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085837440 00000100:00100000:3.0:1788684344.336641:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085837440 00000100:00100000:3.0:1788684344.336676:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788684344.336683:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+12:17150:x1875571085837440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684344.336762:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+12:17150:x1875571085837440:12345-0@lo:503:mount.lustre.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.336770:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788684344.336843:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085837440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788684344.341398:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17203:1875571085837568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684344.341537:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684344.341581:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085837568 00000100:00100000:2.0:1788684344.341587:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085837568 00000100:00100000:2.0:1788684344.341766:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788684344.341826:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+12:17203:x1875571085837568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684344.342431:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742f9d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684344.342569:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+12:17203:x1875571085837568:12345-0@lo:502:llog_process_th.0 Request processed in 746us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684344.342579:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788684344.344078:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17203:1875571085837568:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788684344.344153:0:17203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788684344.344170:0:17203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d67482e3380) 00000020:00000080:0.0:1788684344.344187:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788684344.344276:0:17203:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d66484cb800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788684344.344280:0:17203:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d66484cb800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788684344.344282:0:17203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d66484cb800 4 00010000:00080000:0.0:1788684344.344321:0:17203:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d67749d9000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1788684344.348942:0:17203:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788684344.349132:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788684344.349189:0:17203:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788684344.349201:0:17203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x44bac02bd54ad4f6 00000100:00080000:1.0:1788684344.349211:0:17203:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788684344.349217:0:17203:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d67749d9000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684344.349251:0:17203:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa71880 x1875571085837696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788684344.349282:0:17203:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788684344.350052:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085837696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788684344.350127:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684344.350515:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085837696 00000100:00100000:1.0:1788684344.350522:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085837696 00000100:00100000:1.0:1788684344.350555:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684344.350561:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085837696:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788684344.350616:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085837696:12345-0@lo:38:llog_process_th.0 Request processed in 53us (488us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788684344.350623:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684344.352552:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17203:1875571085837824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684344.352618:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684344.352652:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085837824 00000100:00100000:2.0:1788684344.352657:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085837824 00000100:00100000:2.0:1788684344.352693:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788684344.352701:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+12:17203:x1875571085837824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684344.352796:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+12:17203:x1875571085837824:12345-0@lo:502:llog_process_th.0 Request processed in 95us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684344.352803:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788684344.352835:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674968ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684344.353445:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684344.353454:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d67749d9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684344.353458:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788684344.353462:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085837696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788684344.353700:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17203:1875571085837824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684344.353743:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17203:1875571085837952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684344.353788:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684344.353823:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674968ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684344.354083:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085837952 00000100:00100000:3.0:1788684344.354089:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085837952 00000100:00100000:3.0:1788684344.354130:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684344.354138:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+12:17203:x1875571085837952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684344.354241:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+12:17203:x1875571085837952:12345-0@lo:502:llog_process_th.0 Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.354249:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788684344.354326:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c986901f-6089-4802-a23d-1179db951431:17203:1875571085837952:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788684344.354347:0:17203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788684344.354515:0:17150:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788684344.354539:0:17150:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788684344.354553:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.354564:0:17150:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788684344.354617:0:17150:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788684344.354619:0:17150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684344.354621:0:17150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684344.354621:0:17150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684344.354623:0:17150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684344.354624:0:17150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684344.354625:0:17150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684344.354627:0:17150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684344.354628:0:17150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684344.354629:0:17150:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684344.354632:0:17150:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788684344.354635:0:17150:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684344.354636:0:17150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684344.354637:0:17150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684344.354638:0:17150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684344.354639:0:17150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684344.354640:0:17150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684344.354641:0:17150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684344.354642:0:17150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684344.354643:0:17150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684344.354643:0:17150:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684344.354657:0:17150:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788684344.354667:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085838080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788684344.354699:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684344.354714:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647bd9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788684344.354733:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085838080 00000100:00100000:3.0:1788684344.354737:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085838080 00000100:00100000:3.0:1788684344.354757:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684344.354762:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+12:17150:x1875571085838080:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788684344.354779:0:17164:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788684344.354791:0:17164:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788684344.361541:0:17164:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788684344.361596:0:17164:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788684344.362235:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+12:17150:x1875571085838080:12345-0@lo:253:mount.lustre.0 Request processed in 7466us (7530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.362247:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788684344.362579:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17150:1875571085838080:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788684344.362593:0:17150:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788684344.362596:0:17150:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788684344.362598:0:17150:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788684344.362599:0:17150:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684344.362601:0:17150:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684344.362602:0:17150:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684344.362603:0:17150:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684344.362604:0:17150:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788684344.362606:0:17150:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788684344.362607:0:17150:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684344.362608:0:17150:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788684344.362621:0:17150:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788684344.365687:0:17187:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788684344.365696:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788684344.365717:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684344.365735:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad4c5 expref: 11 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684344.365753:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684344.365790:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad4c5 expref: 11 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684344.365805:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad4c5 expref: 11 pid: 17164 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684344.365818:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085838208:0@lo:104: 00000100:00100000:1.0:1788684344.368102:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684344.368153:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788684344.368350:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085838208 00000100:00100000:3.0:1788684344.368359:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085838208 00000100:00100000:3.0:1788684344.368430:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684344.368439:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085838208:12345-0@lo:104: 00010000:00010000:3.0:1788684344.368454:0:17154:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.368510:0:17154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788684344.368516:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085838208:12345-0@lo:104: Request processed in 79us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.368523:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788684344.368543:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684344.368550:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.368558:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684344.368562:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.368570:0:17160:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684344.368578:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684344.368583:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684344.368615:0:17160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.368628:0:17160:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684344.368653:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.368661:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647890800/0x44bac02bd54ad4c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad4cc expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.368675:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684344.368677:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684344.368678:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684344.368759:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085838208:0@lo:104: 00010000:00010000:1.0:1788684344.368780:0:17187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684344.368813:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684344.368822:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085838336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684344.368867:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684344.369042:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085838336 00000100:00100000:3.0:1788684344.369048:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085838336 00010000:00010000:3.0:1788684344.369076:0:17156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad4c5 expref: 12 pid: 17164 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684344.369103:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684344.369109:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c986901f-6089-4802-a23d-1179db951431+12:3623:x1875571085838336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684344.369118:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684344.369123:0:17156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad4c5 expref: 12 pid: 17164 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369132:0:17156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad4c5 expref: 12 pid: 17164 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369144:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad4cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad4c5 expref: 12 pid: 17164 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369156:0:17156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369172:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788684344.369185:0:17156:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003489207s 00010000:00010000:3.0:1788684344.369190:0:17156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369196:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369203:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369210:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369215:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684344.369219:0:17156:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369227:0:17156:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369238:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684344.369246:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684344.369273:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c986901f-6089-4802-a23d-1179db951431+11:3623:x1875571085838336:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684344.369279:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788684344.369337:0:17187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684344.369345:0:17187:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684344.369351:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b1600/0x44bac02bd54ad4fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684344.369404:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085838336:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788684344.379642:0:17150:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788684344.380393:0:17150:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788684344.380405:0:17210:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788684344.380408:0:17210:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788684344.381109:0:17211:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788684344.381519:0:17150:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788684344.381739:0:17211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788684344.382151:0:17212:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8d6648664700 x1875571085838464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684344.382164:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00000040:01000000:2.0:1788684344.382480:0:17150:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788684344.382509:0:17150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788684344.383423:0:17150:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788684344.383435:0:17150:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788684344.383485:0:17150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684344.384891:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788684344.386473:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788684344.388133:0:17150:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788684344.390213:0:17211:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00080000:10000000:0.0:1788684344.390529:0:17150:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000004:00080000:1.0:1788684344.391245:0:17211:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:1.0:1788684344.401013:0:17150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788684344.405041:0:17150:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788684344.405091:0:17150:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb81ec1983988 00100000:10000000:3.0:1788684344.405098:0:17150:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788684344.407541:0:17150:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788684344.407559:0:17150:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788684344.407583:0:17150:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788684344.407605:0:17150:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788684344.413256:0:17150:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684344.413486:0:17150:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788684345.085491:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684345.407591:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00000040:00080000:3.0:1788684345.410855:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788684345.917486:0:17168:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788684345.917494:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d66484cb800 from 7 10000000:01000000:3.0:1788684345.917498:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788684345.917546:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684345.917557:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684345.917568:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684345.917594:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085838592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788684345.917659:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684345.917721:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684345.917811:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085838592 00000100:00100000:0.0:1788684345.917818:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085838592 00000100:00100000:0.0:1788684345.917875:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788684345.917884:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+11:17168:x1875571085838592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684345.917897:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684345.917911:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad504 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684345.917944:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad504 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684345.917955:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad504 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684345.917963:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890c00, rc 0) 00000100:00100000:0.0:1788684345.918002:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+12:17168:x1875571085838592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684345.918008:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788684345.919491:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085838592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684345.919516:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684345.919528:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684345.919615:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085838720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788684345.919669:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684345.919722:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684345.919827:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085838720 00000100:00100000:0.0:1788684345.919834:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085838720 00000100:00100000:0.0:1788684345.919887:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788684345.919896:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+12:17168:x1875571085838720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788684345.919914:0:17164:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788684345.919941:0:17164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788684345.919944:0:17164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788684345.920027:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+12:17168:x1875571085838720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684345.920035:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788684345.920419:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085838720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788684345.920466:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788684345.920474:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684345.920482:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684346.109612:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684346.429470:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00000040:00080000:2.0:1788684346.433852:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788684347.136066:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684347.453421:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00010000:00010000:0.0:1788684348.164411:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684348.477715:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00000001:02000400:2.0:1788684348.651869:0:17455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788684349.187797:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684349.505061:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00000020:00000004:2.0:1788684349.510712:0:17507:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684349.510898:0:17507:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1788684349.566827:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788684349.566833:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788684349.566836:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684349.566844:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1788684349.566850:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788684349.566857:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d677487b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684349.567063:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085838848:0@lo:400:kworker.0 00000100:00100000:0.0:1788684349.567143:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684349.567232:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085838848 00000100:00100000:1.0:1788684349.567241:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085838848 00000100:00100000:1.0:1788684349.567293:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788684349.567302:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+12:3625:x1875571085838848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684349.567352:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+12:3625:x1875571085838848:12345-0@lo:400:kworker.0 Request processed in 52us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684349.567360:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788684349.567460:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085838848:0@lo:400:kworker.0 00000100:00100000:2.0:1788684349.567626:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876e680 x1875571085838976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684349.567649:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684349.567652:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684349.567655:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684349.567658:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684349.567660:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788684349.567663:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788684349.567665:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d67749d9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684349.567671:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d67749d9000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684349.567688:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876fb80 x1875571085839104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684349.567766:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085838976:0@lo:38:kworker.0 00000100:00100000:0.0:1788684349.567845:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684349.567873:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085839104:0@lo:38:kworker.0 00000100:00100000:0.0:1788684349.568024:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684349.568240:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085838976 00000100:00100000:2.0:1788684349.568325:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085838976 00000100:00100000:1.0:1788684349.568766:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085839104 00000100:00100000:1.0:1788684349.568771:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085839104 00000100:00100000:1.0:1788684349.568797:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684349.568803:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1875571085839104:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788684349.568861:0:17173:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000100:00100000:2.0:1788684349.569009:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684349.569014:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085838976:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788684349.569026:0:17177:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:1.0:1788684349.570101:0:17173:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x44bac02bd54ad512 00000004:00100000:1.0:1788684349.570135:0:17173:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788684349.570279:0:17173:0:(import.c:65:import_set_state_nolock()) ffff8d6775ee2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684349.570396:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875571085839104:12345-0@lo:38:kworker.0 Request processed in 1591us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684349.570406:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788684349.577827:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d664876fb80 x1875571085839104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788684349.577849:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788684349.577859:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788684349.577864:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788684349.577867:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d67749d9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788684349.577874:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085839104:0@lo:38:kworker.0 00000100:00100000:3.0:1788684349.589297:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085838976:12345-0@lo:38:kworker.0 Request processed in 20274us (21445us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788684349.589317:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788684349.589623:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684349.589629:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788684349.589633:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085838976:0@lo:38:kworker.0 00010000:00010000:0.0:1788684350.205655:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788684350.302355:0:17557:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684350.302942:0:17557:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788684350.525453:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00010000:00010000:0.0:1788684351.229676:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684351.556424:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00010000:00010000:3.0:1788684352.258081:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684352.576446:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00010000:00010000:0.0:1788684353.281732:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684353.598872:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00010000:00010000:0.0:1788684354.306747:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684354.621506:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00000100:00100000:0.0:1788684354.686466:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684344/real 1788684344] req@ffff8d66479a7b80 x1875571085836032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788684354.686508:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788684354.686514:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1788684354.686515:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a7b80 x1875571085836032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684354 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788684354.686517:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684354.686524:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 430 00000100:00100000:0.0:1788684354.686526:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684344/real 1788684344] req@ffff8d664876ea00 x1875571085835904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788684354.686531:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788684354.686540:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d677487b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684354.686542:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d664876ea00 x1875571085835904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684354 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788684354.686563:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf25000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684354.686577:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788684354.686580:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a5c00 x1875571085839360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684354.686581:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085836032:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788684354.686588:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf21800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684354.686591:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684354.686593:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:3.0:1788684354.686594:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788684354.686596:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677cf21800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788684354.686597:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085835904:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788684354.686599:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:3.0:1788684354.686601:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788684354.686605:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d677cf21800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684354.686614:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a4000 x1875571085839488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684354.686620:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684354.686623:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788684354.686624:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677cf25000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684354.686627:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:3.0:1788684354.686629:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788684354.686632:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d677cf25000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684354.686634:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085839360:0@lo:38:kworker.0 00000100:00100000:3.0:1788684354.686641:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a5180 x1875571085839616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684354.686685:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788684354.686697:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085839232:0@lo:400:kworker.0 00000100:00100000:0.0:1788684354.686716:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684354.686800:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788684354.686815:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085839744:0@lo:400:kworker.0 00000100:00100000:0.0:1788684354.690244:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085839488:0@lo:8:kworker.0 00000400:00000100:0.0:1788684354.690310:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085839488 offset 0 length 520: 4 00000100:00100000:0.0:1788684354.690418:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085839616:0@lo:8:kworker.0 00000400:00000100:0.0:1788684354.690441:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085839616 offset 0 length 520: 4 00000100:00100000:0.0:1788684354.690483:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085839360 00000100:00100000:0.0:1788684354.690491:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085839360 00000100:00100000:0.0:1788684354.690613:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788684354.690621:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085839360:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788684354.690644:0:17176:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788684354.692550:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684354.692625:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085839232 00000100:00100000:3.0:1788684354.692635:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085839232 00000100:00100000:3.0:1788684354.692709:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788684354.692721:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+12:3625:x1875571085839232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684354.694562:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+12:3625:x1875571085839232:12345-0@lo:400:kworker.0 Request processed in 1839us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684354.694575:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788684354.694852:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085839232:0@lo:400:kworker.0 00000100:00100000:1.0:1788684354.695457:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684354.695534:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085839744 00000100:00100000:3.0:1788684354.695542:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085839744 00000100:00100000:3.0:1788684354.695589:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684354.695599:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085839744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684354.705597:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085839744:12345-0@lo:400:kworker.0 Request processed in 9985us (10127us total) trans 0 rc 0/0 00010000:00080000:1.0:1788684354.705610:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d66479a7480 x1875571085839744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684354.705615:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684354.705628:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085839744:0@lo:400:kworker.0 00000100:00100000:0.0:1788684354.712667:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085839360:12345-0@lo:38:kworker.0 Request processed in 22034us (25940us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788684354.712682:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788684354.716273:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684354.716286:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788684354.716291:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085839360:0@lo:38:kworker.0 00010000:00010000:2.0:1788684355.341729:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684355.647712:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00010000:00010000:0.0:1788684356.349829:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684356.669572:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00000040:00080000:2.0:1788684356.670845:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788684357.373844:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788684357.631973:0:17902:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788684357.631976:0:17902:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788684357.631978:0:17902:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788684357.632098:0:17902:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d678003e800 00000020:01000004:2.0:1788684357.632113:0:17902:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788684357.632124:0:17902:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788684357.632137:0:17902:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8d677e143380) 00000020:00000080:2.0:1788684357.632262:0:17902:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1788684357.696228:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00100000:10000000:0.0:1788684357.764429:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788684357.776279:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788684357.795566:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788684357.796008:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788684357.807226:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788684357.814160:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788684357.819506:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788684357.821882:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788684357.823639:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788684357.824507:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788684357.825573:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788684357.826875:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788684357.828891:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788684357.830620:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788684357.835300:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788684357.843978:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788684357.844648:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788684357.844945:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788684357.845939:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788684357.847267:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788684357.848453:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788684357.848969:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788684357.853063:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788684357.853655:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788684357.854782:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788684357.855296:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788684357.855877:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788684357.856130:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788684357.857419:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788684357.857804:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788684357.860101:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788684357.861881:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788684357.863506:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788684357.863967:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788684357.865606:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788684357.866036:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788684357.867022:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788684357.867542:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788684357.868432:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788684357.869459:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788684357.870259:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788684357.870688:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788684357.871241:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788684357.872289:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788684357.872747:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788684357.873251:0:17902:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:1.0:1788684357.878681:0:17902:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788684357.878936:0:17902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788684357.878952:0:17902:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788684357.878964:0:17902:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ad520 00000020:01000004:1.0:1788684357.878971:0:17902:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788684357.879000:0:17902:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788684357.879004:0:17902:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788684357.879010:0:17902:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788684357.879037:0:17902:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788684357.879041:0:17902:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788684357.897759:0:17902:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788684357.897802:0:17902:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788684357.897807:0:17902:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788684357.897809:0:17902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684357.897810:0:17902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684357.897811:0:17902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684357.897812:0:17902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684357.897814:0:17902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684357.897815:0:17902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684357.897817:0:17902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684357.897818:0:17902:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684357.897822:0:17902:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788684357.897825:0:17902:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684357.897826:0:17902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684357.897828:0:17902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684357.897829:0:17902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684357.897830:0:17902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684357.897831:0:17902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684357.897832:0:17902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684357.897833:0:17902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684357.897835:0:17902:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684357.897936:0:17902:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788684357.898008:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085839872:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788684357.898077:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684357.898210:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50900 going to sleep for 11 seconds 00000100:00100000:3.0:1788684357.898663:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085839872 00000100:00100000:3.0:1788684357.898672:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085839872 00000100:00100000:3.0:1788684357.898735:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788684357.898754:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+12:17902:x1875571085839872:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788684357.898792:0:17164:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788684357.898795:0:17164:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788684357.898803:0:17164:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788684357.899648:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+12:17902:x1875571085839872:12345-0@lo:253:mount.lustre.0 Request processed in 894us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684357.899657:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788684357.899837:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085839872:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788684357.899851:0:17902:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788684357.899922:0:17902:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788684357.899925:0:17902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684357.899926:0:17902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684357.899927:0:17902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684357.899929:0:17902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684357.899930:0:17902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684357.899931:0:17902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684357.899932:0:17902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684357.899934:0:17902:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788684357.900077:0:17902:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d678003e800 from lustre-MDT0001 10000000:01000000:3.0:1788684357.900192:0:17902:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788684357.900195:0:17902:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788684357.900202:0:17902:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d677e3eb380 local copy 00010000:00010000:3.0:1788684357.900214:0:17902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684357.900433:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684357.900479:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684357.900514:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67560f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788684357.900594:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085840000 00000100:00100000:1.0:1788684357.900600:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085840000 00000100:00100000:1.0:1788684357.900631:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684357.900638:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+12:17902:x1875571085840000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684357.900708:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+12:17902:x1875571085840000:12345-0@lo:501:mount.lustre.0 Request processed in 70us (229us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788684357.900715:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788684357.900821:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840000:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788684357.900835:0:17902:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788684357.900851:0:17902:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788684357.900934:0:17902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684357.901015:0:17902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684357.901045:0:17902:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d678003e800 10000000:01000000:3.0:1788684357.901057:0:17902:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788684357.901062:0:17902:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d677e3eb380 10000000:01000000:3.0:1788684357.901065:0:17902:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788684357.901068:0:17902:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d677e3eb380 from 1 10000000:01000000:3.0:1788684357.901071:0:17902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788684357.901212:0:17902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684357.901220:0:17902:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684357.901230:0:17902:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684357.901245:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684357.901272:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684357.901594:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67560f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788684357.901672:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085840128 00000100:00100000:0.0:1788684357.901678:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085840128 00000100:00100000:0.0:1788684357.901719:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788684357.901728:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+12:17902:x1875571085840128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684357.901738:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684357.901752:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647890800/0x44bac02bd54ad52e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad527 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684357.901775:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647890800/0x44bac02bd54ad52e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad527 expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684357.901785:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647890800/0x44bac02bd54ad52e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad527 expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684357.901794:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890800, rc 0) 00000100:00100000:0.0:1788684357.901889:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+13:17902:x1875571085840128:12345-0@lo:101:mount.lustre.0 Request processed in 162us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684357.901895:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684357.902197:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684357.902213:0:17902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad52e expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684357.902222:0:17902:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad52e expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684357.902241:0:17902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788684357.902259:0:17902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad52e expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684357.902266:0:17902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad52e expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684357.902292:0:17902:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d678003e800 10000000:01000000:3.0:1788684357.902296:0:17902:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788684357.902300:0:17902:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d678003e800 from 1 10000000:01000000:3.0:1788684357.902302:0:17902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788684357.902334:0:17902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684357.902341:0:17902:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684357.902348:0:17902:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684357.902391:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684357.902426:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684357.902448:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67560f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788684357.902581:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085840256 00000100:00100000:1.0:1788684357.902586:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085840256 00000100:00100000:1.0:1788684357.902621:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788684357.902629:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+13:17902:x1875571085840256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684357.902636:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684357.902645:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477b0e00/0x44bac02bd54ad53c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad535 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684357.902659:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b0e00/0x44bac02bd54ad53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad535 expref: 14 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684357.902667:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477b0e00/0x44bac02bd54ad53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad535 expref: 14 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684357.902682:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0e00, rc 0) 00000100:00100000:1.0:1788684357.902710:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+14:17902:x1875571085840256:12345-0@lo:101:mount.lustre.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684357.902716:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788684357.902789:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684357.902800:0:17902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684357.902808:0:17902:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684357.902818:0:17902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788684357.902828:0:17902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684357.902834:0:17902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684357.902840:0:17902:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788684357.902844:0:17902:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788684357.902849:0:17902:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d678003e800 10000000:01000000:2.0:1788684357.902851:0:17902:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788684357.902866:0:17902:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788684357.902868:0:17902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788684357.902884:0:17902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684357.902892:0:17902:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684357.902899:0:17902:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684357.902911:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788684357.902935:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684357.902972:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684357.903270:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085840384 00000100:00100000:1.0:1788684357.903275:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085840384 00000100:00100000:1.0:1788684357.903310:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788684357.903329:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+14:17902:x1875571085840384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684357.903337:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684357.903346:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477b1000/0x44bac02bd54ad54a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad543 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684357.903360:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b1000/0x44bac02bd54ad54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad543 expref: 15 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684357.903395:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477b1000/0x44bac02bd54ad54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad543 expref: 15 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684357.903401:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1000, rc 0) 00000100:00100000:1.0:1788684357.903431:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085840384:12345-0@lo:101:mount.lustre.0 Request processed in 114us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684357.903437:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788684357.903595:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684357.903610:0:17902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684357.903618:0:17902:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788684357.905301:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1788684357.906044:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684357.914046:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788684357.914184:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788684357.914200:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788684357.914212:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788684357.914228:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1788684357.914242:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1788684357.914253:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1788684357.914264:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788684357.914275:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788684357.914287:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1788684357.914298:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1788684357.914312:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1788684357.914570:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1788684357.914588:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788684357.914603:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788684357.914619:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1788684357.914630:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788684357.914644:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788684357.914659:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1788684357.914670:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788684357.914683:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788684357.914697:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788684357.914710:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788684357.914740:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1788684357.914746:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1788684357.914844:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684357.916028:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684357.916133:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684357.924978:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085840512 00000100:00100000:1.0:1788684357.925006:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085840512 00000100:00100000:0.0:1788684357.931713:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684357.931727:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085840512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684357.931951:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085840512:12345-0@lo:501:mount.lustre.0 Request processed in 226us (15928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684357.931959:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684357.932057:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684357.932128:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684357.932191:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684357.943066:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085840640 00000100:00100000:2.0:1788684357.943082:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085840640 00000100:00100000:2.0:1788684357.945021:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684357.946342:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684357.946356:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085840640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684357.948954:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085840640:12345-0@lo:503:mount.lustre.0 Request processed in 2593us (16754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684357.948970:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684357.949097:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788684357.949581:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788684357.949659:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684357.949709:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684357.949737:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684357.949929:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085840768 00000100:00100000:0.0:1788684357.949935:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085840768 00000100:00100000:0.0:1788684357.949983:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684357.950002:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085840768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684357.950765:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085840768:12345-0@lo:502:mount.lustre.0 Request processed in 761us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684357.950774:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788684357.950878:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684357.951429:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788684357.951464:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1788684357.951483:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1788684357.951498:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1788684357.951511:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1788684357.951522:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1788684357.951533:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1788684357.951546:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1788684357.951560:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1788684357.951576:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1788684357.951589:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1788684357.951602:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1788684357.951615:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1788684357.951628:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1788684357.951640:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1788684357.951653:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1788684357.951665:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1788684357.951677:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1788684357.951691:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1788684357.951705:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1788684357.951718:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1788684357.951730:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1788684357.951754:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1788684357.951770:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1788684357.951782:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1788684357.951795:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1788684357.951807:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1788684357.951821:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1788684357.951833:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1788684357.951845:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1788684357.951871:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1788684357.951886:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1788684357.951901:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1788684357.951921:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1788684357.951936:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1788684357.951965:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1788684357.951980:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1788684357.952004:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1788684357.952020:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1788684357.952033:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1788684357.952046:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1788684357.952058:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1788684357.952069:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1788684357.952082:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1788684357.952118:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684357.952179:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684357.952214:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684357.953592:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085840896 00000100:00100000:0.0:1788684357.953604:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085840896 00000100:00100000:0.0:1788684357.953669:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684357.953679:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085840896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684357.953829:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085840896:12345-0@lo:502:mount.lustre.0 Request processed in 151us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684357.953836:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788684357.954406:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085840896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684357.954487:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788684357.954503:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788684357.955823:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684357.955836:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684357.955837:0:17906:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788684357.955843:0:17906:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788684357.955846:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684357.955937:0:17906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8d6777218000) 00000020:00000080:3.0:1788684357.955960:0:17906:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788684357.955968:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788684357.956067:0:17906:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788684357.956074:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ad558 00000020:00000080:3.0:1788684357.956293:0:17906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788684357.956298:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684357.956301:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684357.956309:0:17906:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788684357.956313:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684357.956537:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684357.956539:0:17906:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788684357.956545:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684357.956554:0:17906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8d677721cd40) 00000020:00000080:3.0:1788684357.956566:0:17906:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788684357.956571:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788684357.956573:0:17906:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788684357.956575:0:17906:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788684357.956581:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788684357.956630:0:17906:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d678003e800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788684357.956642:0:17906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8d67772199c0) 00000020:00000080:3.0:1788684357.956650:0:17906:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788684357.956716:0:17906:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788684357.956722:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ad56d 00000020:00000080:3.0:1788684357.956810:0:17906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788684357.956817:0:17906:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788684357.956821:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x44bac02bd54ad574 00080000:01000000:3.0:1788684357.956827:0:17906:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788684357.956830:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ad57b 00010000:00010000:0.0:1788684358.025280:0:17906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788684358.025935:0:17906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1788684358.026201:0:17906:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788684358.027297:0:17906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788684358.027309:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684358.027327:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684358.027335:0:17906:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788684358.027341:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684358.027346:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684358.027347:0:17906:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788684358.027350:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788684358.027355:0:17906:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:1.0:1788684358.027412:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788684358.027427:0:17906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8d677e3ecd40) 00000020:00000080:1.0:1788684358.027447:0:17906:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788684358.027453:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788684358.027533:0:17906:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788684358.027540:0:17906:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788684358.027547:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ad589 00010000:00080000:1.0:1788684358.027578:0:17906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677cc88800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1788684358.029135:0:17906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788684358.038935:0:17906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788684358.038949:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788684358.039002:0:17906:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788684358.039022:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ad590 00000100:00080000:3.0:1788684358.039034:0:17906:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684358.039041:0:17906:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d677cc88800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684358.039073:0:17906:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a4e00 x1875571085841024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684358.039131:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085841024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788684358.039198:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788684358.039268:0:17906:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788684358.039328:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684358.039333:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.039346:0:17906:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788684358.039349:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788684358.039352:0:17906:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788684358.039353:0:17906:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788684358.039355:0:17906:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788684358.039356:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788684358.039359:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.039360:0:17906:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788684358.039362:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684358.039386:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.039387:0:17906:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788684358.039391:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788684358.039422:0:17906:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788684358.039434:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684358.039437:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.039438:0:17906:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788684358.039440:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788684358.039442:0:17906:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788684358.039444:0:17906:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788684358.039445:0:17906:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788684358.039447:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788684358.039448:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.039450:0:17906:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788684358.039452:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788684358.039455:0:17906:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788684358.039459:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.039460:0:17906:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788684358.039462:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788684358.039466:0:17906:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:3.0:1788684358.039485:0:17906:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788684358.039488:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684358.039557:0:17906:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d6746c019c0) 00000020:00000080:3.0:1788684358.039573:0:17906:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788684358.039579:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788684358.039636:0:17906:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788684358.039642:0:17906:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788684358.039648:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ad59e 00010000:00080000:3.0:1788684358.039677:0:17906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d664773f000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.144@tcp at head 00000100:00100000:0.0:1788684358.039982:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085841024 00000100:00100000:0.0:1788684358.040000:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085841024 00000100:00100000:0.0:1788684358.040033:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684358.040041:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085841024:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788684358.040067:0:17177:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:0.0:1788684358.040096:0:17177:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ad5a5 00000004:00100000:0.0:1788684358.040120:0:17177:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788684358.040127:0:17177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788684358.040248:0:17906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1788684358.041167:0:17906:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788684358.041468:0:17906:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788684358.041700:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788684358.041704:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788684358.041707:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684358.041712:0:14645:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:1.0:1788684358.041717:0:14645:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788684358.041722:0:14645:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d677487b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684358.041742:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa72a00 x1875571085841280/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:3.0:1788684358.043083:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684358.043277:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788684358.043566:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:2.0:1788684358.043812:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085841280:0@lo:38:kworker.0 00000100:00100000:2.0:1788684358.043889:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684358.043931:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788684358.043940:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085841152:0@lo:400:kworker.0 00000100:00100000:2.0:1788684358.043969:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684358.044020:0:17176:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788684358.044029:0:17176:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:1.0:1788684358.044089:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684358.044095:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684358.044098:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684358.044101:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788684358.044307:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684358.044329:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085841408:0@lo:400:kworker.0 00000100:00100000:1.0:1788684358.044363:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684358.044407:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085841408 00000100:00100000:1.0:1788684358.044414:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085841408 00000100:00100000:1.0:1788684358.044457:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684358.044466:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085841408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684358.044517:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085841408:12345-0@lo:400:kworker.0 Request processed in 51us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.044524:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788684358.044561:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d677fa72d80 x1875571085841408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684358.044574:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085841408:0@lo:400:kworker.0 00000040:00080000:1.0:1788684358.045073:0:17911:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788684358.045078:0:17911:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788684358.045963:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085841280 00000100:00100000:2.0:1788684358.045970:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085841280 00000100:00100000:2.0:1788684358.046014:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085841152 00000100:00100000:2.0:1788684358.046018:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085841152 00000100:00100000:2.0:1788684358.046053:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788684358.046062:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+15:3623:x1875571085841152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684358.046125:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+15:3623:x1875571085841152:12345-0@lo:400:kworker.0 Request processed in 64us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684358.046132:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788684358.046177:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085841152:0@lo:400:kworker.0 00000020:00000080:3.0:1788684358.047492:0:17906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788684358.047506:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788684358.047550:0:17906:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788684358.047570:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ad5ac 00000100:00080000:3.0:1788684358.047578:0:17906:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684358.047584:0:17906:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d664773f000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684358.047614:0:17906:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a5f80 x1875571085841536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684358.047643:0:17906:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788684358.047669:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684358.047673:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684358.047676:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684358.047678:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788684358.047728:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684358.047732:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.047734:0:17906:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788684358.047737:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788684358.047739:0:17906:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788684358.047746:0:17906:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788684358.047748:0:17906:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788684358.047749:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788684358.047752:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.047753:0:17906:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788684358.047756:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788684358.047760:0:17906:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788684358.047763:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.047764:0:17906:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788684358.047767:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788684358.047770:0:17906:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:3.0:1788684358.047791:0:17906:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788684358.047794:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684358.047805:0:17906:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d6746c00000) 00000020:00000080:3.0:1788684358.047817:0:17906:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788684358.047822:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788684358.047953:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085841536:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788684358.048018:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085841536 offset 0 length 520: 4 00000004:00080000:3.0:1788684358.048116:0:17906:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788684358.048123:0:17906:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788684358.048129:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ad5ba 00010000:00080000:3.0:1788684358.048162:0:17906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6775fa6000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684358.048501:0:17906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788684358.048566:0:17906:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788684358.048579:0:17906:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788684358.048998:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788684358.049007:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1875571085841280:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788684358.049073:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1875571085841280:12345-0@lo:38:kworker.0 Request processed in 65us (5183us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788684358.049080:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684358.049218:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684358.049226:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684358.049231:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788684358.049235:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085841280:0@lo:38:kworker.0 00000040:00080000:3.0:1788684358.050752:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684358.051007:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788684358.051129:0:17906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:3.0:1788684358.051742:0:17177:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684358.051820:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875571085841024:12345-0@lo:38:llog_process_th.0 Request processed in 11777us (12620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684358.051830:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788684358.051899:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788684358.051907:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788684358.051923:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788684358.051928:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788684358.051931:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc88800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788684358.051943:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085841024:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788684358.052038:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085841664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684358.052074:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684358.052206:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085841664 00000100:00100000:2.0:1788684358.052213:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085841664 00000100:00100000:2.0:1788684358.052256:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684358.052265:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1875571085841664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684358.052288:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788684358.052349:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1875571085841664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684358.052356:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684358.052406:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085841664:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788684358.052831:0:17914:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788684358.052836:0:17914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788684358.053969:0:17906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788684358.053982:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788684358.054091:0:17906:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788684358.054112:0:17906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ad5c1 00000100:00080000:3.0:1788684358.054122:0:17906:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684358.054127:0:17906:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d6775fa6000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684358.054157:0:17906:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a4700 x1875571085841792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684358.054223:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085841792:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788684358.054271:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085841792 offset 0 length 520: 4 00000100:00080000:3.0:1788684358.054352:0:17906:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788684358.054514:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684358.054518:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.054519:0:17906:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788684358.054522:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684358.054525:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.054527:0:17906:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684358.054529:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684358.054531:0:17906:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788684358.054533:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684358.054535:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.054537:0:17906:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788684358.054539:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684358.054541:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.054543:0:17906:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788684358.054557:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788684358.054584:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684358.054587:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684358.054589:0:17906:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788684358.054592:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:1.0:1788684358.055050:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684358.055056:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684358.055058:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684358.055069:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788684358.055088:0:17902:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788684358.055118:0:17902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788684358.055192:0:17902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.055203:0:17902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684358.055211:0:17902:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d678003e800 from 1 10000000:01000000:1.0:1788684358.055214:0:17902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788684358.055241:0:17902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.055249:0:17902:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.055258:0:17902:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684358.055275:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085841920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788684358.055326:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684358.055353:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742ffdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684358.055531:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085841920 00000100:00100000:3.0:1788684358.055537:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085841920 00000100:00100000:3.0:1788684358.055637:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788684358.055646:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+15:17902:x1875571085841920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684358.055657:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684358.055668:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad5c8 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684358.055688:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad5c8 expref: 16 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684358.055697:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad5c8 expref: 16 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684358.055705:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c200, rc 0) 00000100:00100000:3.0:1788684358.055746:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+16:17902:x1875571085841920:12345-0@lo:101:mount.lustre.0 Request processed in 102us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684358.055752:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788684358.055851:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085841920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684358.055876:0:17902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.055884:0:17902:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684358.056482:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842048:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788684358.056522:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684358.057041:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085842048 00000100:00100000:2.0:1788684358.057048:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085842048 00000100:00100000:0.0:1788684358.057116:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788684358.057128:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+16:17902:x1875571085842048:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788684358.057161:0:17165:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788684358.057177:0:17165:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788684358.057180:0:17165:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788684358.057253:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+16:17902:x1875571085842048:12345-0@lo:256:mount.lustre.0 Request processed in 128us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684358.057260:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788684358.057309:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742ffdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684358.057339:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842048:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788684358.058056:0:17902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684358.058072:0:17902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684358.058081:0:17902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684358.058096:0:17902:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d678003e800 from 1 10000000:01000000:0.0:1788684358.058098:0:17902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684358.058126:0:17902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684358.058133:0:17902:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684358.058140:0:17902:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684358.058154:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684358.058190:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684358.058209:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788684358.058229:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085842176 00000100:00100000:0.0:1788684358.058233:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085842176 00000100:00100000:0.0:1788684358.058257:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684358.058263:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+16:17902:x1875571085842176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684358.058270:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684358.058280:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad5d6 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684358.058296:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad5d6 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684358.058305:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad5d6 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684358.058439:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891c00, rc 0) 00000100:00100000:0.0:1788684358.058469:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842176:12345-0@lo:101:mount.lustre.0 Request processed in 205us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684358.058474:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684358.058513:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684358.058526:0:17902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684358.058533:0:17902:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684358.058662:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788684358.058691:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684358.058715:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684358.058728:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684358.058740:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085842304 00000100:00100000:0.0:1788684358.058742:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085842304 00000100:00100000:0.0:1788684358.058759:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684358.058763:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684358.058829:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842304:12345-0@lo:501:mount.lustre.0 Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684358.058835:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684358.059067:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684358.059090:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684358.059129:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684358.059158:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684358.059219:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085842432 00000100:00100000:2.0:1788684358.059224:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085842432 00000100:00100000:2.0:1788684358.059243:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684358.059249:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788684358.059340:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842432:12345-0@lo:503:mount.lustre.0 Request processed in 91us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684358.059347:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684358.059565:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842432:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788684358.060550:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788684358.060644:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684358.060698:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684358.060727:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684358.061001:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085842560 00000100:00100000:2.0:1788684358.061006:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085842560 00000100:00100000:2.0:1788684358.061048:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788684358.061055:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684358.061154:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842560:12345-0@lo:502:mount.lustre.0 Request processed in 98us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684358.061162:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788684358.061487:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684358.061703:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788684358.061731:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788684358.061744:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788684358.061757:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788684358.061769:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788684358.061781:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788684358.061793:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788684358.063742:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788684358.063795:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788684358.063808:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788684358.063821:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788684358.063892:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684358.063956:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684358.064011:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684358.065295:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085842688 00000100:00100000:2.0:1788684358.065305:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085842688 00000100:00100000:2.0:1788684358.065387:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684358.065396:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684358.065537:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842688:12345-0@lo:502:mount.lustre.0 Request processed in 141us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684358.065544:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788684358.065708:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788684358.065791:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788684358.065803:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788684358.067039:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684358.067050:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684358.067052:0:17916:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788684358.067061:0:17916:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d678003e800 00000020:00000080:2.0:1788684358.067064:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788684358.067071:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684358.067074:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684358.067075:0:17916:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788684358.067077:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684358.067078:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684358.067079:0:17916:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788684358.067158:0:17916:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d678003e800 00000020:00000080:2.0:1788684358.067161:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788684358.067268:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684358.067273:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684358.067274:0:17916:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788684358.067277:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684358.067279:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684358.067280:0:17916:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788684358.067284:0:17916:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d678003e800 00000020:00000080:2.0:1788684358.067287:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788684358.068458:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684358.068467:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684358.068469:0:17916:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788684358.068473:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684358.068476:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684358.068477:0:17916:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788684358.068481:0:17916:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d678003e800 00000020:00000080:2.0:1788684358.068482:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788684358.068547:0:17916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684358.068551:0:17916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684358.068552:0:17916:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788684358.068555:0:17916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788684358.071775:0:17902:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788684358.071832:0:17902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788684358.071869:0:17902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684358.071888:0:17902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684358.071947:0:17902:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788684358.071949:0:17902:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d678003e800 10000000:01000000:3.0:1788684358.071953:0:17902:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d678003e800 10000000:01000000:3.0:1788684358.071957:0:17902:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788684358.071963:0:17902:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d678003e800 from 1 10000000:01000000:3.0:1788684358.071966:0:17902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788684358.072012:0:17902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684358.072020:0:17902:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684358.072029:0:17902:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684358.072050:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684358.072129:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684358.077181:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085842816 00000100:00100000:3.0:1788684358.077185:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d675ebf4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684358.077195:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085842816 00000100:00100000:1.0:1788684358.077512:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788684358.077525:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+17:17902:x1875571085842816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684358.077541:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684358.077560:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477b0c00/0x44bac02bd54ad5eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad5e4 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.077588:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b0c00/0x44bac02bd54ad5eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad5e4 expref: 18 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.077601:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477b0c00/0x44bac02bd54ad5eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad5e4 expref: 18 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.077612:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0c00, rc 0) 00000100:00100000:1.0:1788684358.077687:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085842816:12345-0@lo:101:mount.lustre.0 Request processed in 164us (5556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.077696:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788684358.077964:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684358.077982:0:17902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684358.078005:0:17902:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788684358.079945:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788684358.080271:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684358.081070:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788684358.081108:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788684358.081128:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788684358.081148:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788684358.081166:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788684358.081189:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788684358.081211:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788684358.081232:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788684358.081252:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788684358.081269:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788684358.081283:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788684358.081298:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788684358.081313:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788684358.081327:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788684358.081344:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788684358.081966:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788684358.082004:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788684358.082022:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788684358.082037:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788684358.082052:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788684358.082068:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788684358.082083:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788684358.082105:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788684358.082126:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788684358.082146:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788684358.082167:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788684358.082188:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788684358.082209:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788684358.082234:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788684358.082247:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788684358.082351:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684358.088470:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684358.090013:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085842944 00000100:00100000:3.0:1788684358.090016:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d675ebf4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788684358.090026:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085842944 00000100:00100000:1.0:1788684358.090085:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788684358.090095:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085842944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684358.090253:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085842944:12345-0@lo:501:mount.lustre.0 Request processed in 160us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.090270:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788684358.090471:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085842944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684358.090999:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684358.091053:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684358.091082:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d675ebf4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788684358.091142:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085843072 00000100:00100000:1.0:1788684358.091147:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085843072 00000100:00100000:1.0:1788684358.091181:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788684358.091189:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085843072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684358.091284:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085843072:12345-0@lo:503:mount.lustre.0 Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.091290:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788684358.091546:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788684358.092078:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788684358.092161:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684358.092200:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684358.092231:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085843200 00000100:00100000:3.0:1788684358.092235:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085843200 00000100:00100000:3.0:1788684358.095684:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788684358.095704:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085843200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684358.095863:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085843200:12345-0@lo:502:mount.lustre.0 Request processed in 155us (3650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684358.095871:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788684358.101456:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d675ebf4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684358.101510:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684358.101753:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788684358.101784:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1788684358.101802:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1788684358.101818:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1788684358.101832:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1788684358.102014:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1788684358.102034:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1788684358.102049:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1788684358.102064:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1788684358.102078:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1788684358.102091:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1788684358.102104:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1788684358.102119:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1788684358.102130:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1788684358.102141:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1788684358.102151:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1788684358.102161:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1788684358.102171:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1788684358.102181:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1788684358.102201:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1788684358.102212:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1788684358.102233:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1788684358.102245:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1788684358.102257:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1788684358.102268:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1788684358.102279:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1788684358.102290:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1788684358.102301:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1788684358.102312:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1788684358.102419:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1788684358.102432:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1788684358.102444:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1788684358.102455:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1788684358.102466:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1788684358.102536:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1788684358.102553:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1788684358.102565:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1788684358.102591:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1788684358.102606:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1788684358.102618:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1788684358.102630:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1788684358.102641:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1788684358.102652:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1788684358.102665:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1788684358.102677:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1788684358.102689:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1788684358.102700:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1788684358.102712:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1788684358.102754:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684358.102821:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684358.103453:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085843328 00000100:00100000:3.0:1788684358.103462:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085843328 00000100:00100000:3.0:1788684358.105299:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788684358.105313:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085843328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684358.105453:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684358.106803:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085843328:12345-0@lo:502:mount.lustre.0 Request processed in 1488us (3976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684358.106825:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684358.106967:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684358.107206:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1788684358.107237:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1788684358.107270:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684358.107329:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684358.108756:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684358.116643:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085843456 00000100:00100000:3.0:1788684358.116656:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085843456 00000100:00100000:3.0:1788684358.116695:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788684358.116704:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085843456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684358.116850:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085843456:12345-0@lo:502:mount.lustre.0 Request processed in 146us (9532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684358.116932:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788684358.116998:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788684358.117088:0:17902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788684358.117102:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788684358.123159:0:17923:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788684358.123182:0:17923:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8d677e1419c0) 00000020:00000080:2.0:1788684358.123204:0:17923:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788684358.123285:0:17923:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d678003e800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788684358.123289:0:17923:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d678003e800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788684358.123291:0:17923:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d678003e800 3 00010000:00080000:2.0:1788684358.123334:0:17923:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6646494000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1788684358.127083:0:17923:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788684358.127306:0:17923:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788684358.127810:0:17923:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788684358.127824:0:17923:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x44bac02bd54ad5f9 00000100:00080000:1.0:1788684358.127835:0:17923:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788684358.127841:0:17923:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d6646494000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684358.127951:0:17923:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa72a00 x1875571085843584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684358.128016:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085843584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788684358.128087:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788684358.128143:0:17923:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788684358.128330:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684358.128336:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684358.128339:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684358.128342:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788684358.128581:0:17923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1788684358.128632:0:17902:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788684358.128663:0:17902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788684358.128679:0:17902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.128689:0:17902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788684358.128738:0:17902:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788684358.128740:0:17902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684358.128742:0:17902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684358.128743:0:17902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684358.128744:0:17902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684358.128745:0:17902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684358.128746:0:17902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684358.128748:0:17902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684358.128749:0:17902:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684358.128753:0:17902:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788684358.128756:0:17902:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684358.128757:0:17902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684358.128758:0:17902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684358.128759:0:17902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684358.128760:0:17902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684358.128761:0:17902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684358.128767:0:17902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684358.128768:0:17902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684358.128769:0:17902:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684358.128784:0:17902:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788684358.128794:0:17902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788684358.128831:0:17902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684358.128867:0:17902:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684358.128887:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085843712 00000100:00100000:1.0:1788684358.128892:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085843712 00000100:00100000:1.0:1788684358.128925:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788684358.128932:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17902:x1875571085843712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788684358.128955:0:17163:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788684358.128969:0:17163:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788684358.133740:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085843584 00000100:00100000:1.0:1788684358.133755:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085843584 00000100:00100000:1.0:1788684358.133795:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684358.133803:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085843584:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788684358.133829:0:17172:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:1.0:1788684358.133932:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x44bac02bd54ad600 00000004:00100000:1.0:1788684358.133949:0:17172:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788684358.133981:0:17172:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684358.134967:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875571085843584:12345-0@lo:38:llog_process_th.0 Request processed in 1159us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.134979:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000001:00100000:1.0:1788684358.136289:0:17151:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788684358.136332:0:17163:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788684358.136343:0:17163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788684358.136359:0:17187:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788684358.136386:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788684358.136417:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.136434:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad504 expref: 18 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.136442:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad5c8 expref: 18 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.136450:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.136632:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad5c8 expref: 18 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.136648:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad5c8 expref: 18 pid: 17164 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684358.136661:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085843840:0@lo:104: 00000100:00100000:1.0:1788684358.136721:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684358.136766:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad504 expref: 18 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.136775:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad504 expref: 18 pid: 17165 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684358.136783:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa73b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085843968:0@lo:104: 00000100:00100000:1.0:1788684358.136805:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684358.136824:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67771d9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684358.136876:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085843840 00000100:00100000:1.0:1788684358.136883:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085843840 00000100:00100000:1.0:1788684358.136918:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085843968 00000100:00100000:1.0:1788684358.136922:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085843968 00000100:00100000:1.0:1788684358.136937:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684358.136945:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+4:17187:x1875571085843840:12345-0@lo:104: 00010000:00010000:1.0:1788684358.136958:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137023:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788684358.137029:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+4:17187:x1875571085843840:12345-0@lo:104: Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.137036:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684358.137052:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684358.137058:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085843968:12345-0@lo:104: 00010000:00010000:1.0:1788684358.137066:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137100:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788684358.137105:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085843968:12345-0@lo:104: Request processed in 48us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.137111:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684358.137145:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085843840:0@lo:104: 00000100:00100000:1.0:1788684358.137154:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa73b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085843968:0@lo:104: 00010000:00010000:1.0:1788684358.137172:0:17187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137188:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684358.137194:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137211:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1c00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684358.137216:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137224:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684358.137232:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684358.137238:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684358.137264:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137272:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684358.137291:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137298:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad5c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad5cf expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137311:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684358.137786:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137794:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711da00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684358.137796:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137813:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684358.137819:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684358.137824:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684358.137840:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137846:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684358.137912:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137920:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711da00/0x44bac02bd54ad504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad50b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.137934:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684358.137936:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684358.137937:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684358.137957:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085844096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684358.138002:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684358.138032:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684358.138037:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085844224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684358.138056:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684358.138093:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085844096 00000100:00100000:1.0:1788684358.138098:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085844096 00010000:00010000:1.0:1788684358.138115:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad5c8 expref: 19 pid: 17164 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684358.138149:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085844224 00000100:00100000:1.0:1788684358.138152:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085844224 00010000:00010000:1.0:1788684358.138164:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad504 expref: 20 pid: 17165 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684358.138175:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684358.138181:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+20:3623:x1875571085844096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684358.138190:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684358.138194:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad5c8 expref: 20 pid: 17164 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.138203:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad5c8 expref: 20 pid: 17164 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.138214:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad5cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad5c8 expref: 20 pid: 17164 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.138225:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684358.138253:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+19:3623:x1875571085844096:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.138259:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684358.138271:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684358.138276:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+18:3623:x1875571085844224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684358.138284:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684358.138287:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad504 expref: 18 pid: 17165 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.138295:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad504 expref: 18 pid: 17165 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.138311:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ad50b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad504 expref: 18 pid: 17165 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.140768:0:17157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.140780:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788684358.140800:0:17157:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004437080s 00010000:00010000:1.0:1788684358.140806:0:17157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.140814:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.140821:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.140829:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.140835:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684358.140840:0:17157:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.140908:0:17157:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.140928:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.140950:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684358.141024:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+17:3623:x1875571085844224:12345-0@lo:103:ldlm_bl.0 Request processed in 2744us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.141034:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788684358.141075:0:17187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.141083:0:17187:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684358.141089:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad607 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684358.141132:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085844224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684358.141142:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085844096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684358.141659:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+16:17902:x1875571085843712:12345-0@lo:253:mount.lustre.0 Request processed in 12724us (12824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.141669:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788684358.141718:0:17902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:17902:1875571085843712:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788684358.141730:0:17902:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788684358.141733:0:17902:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788684358.141735:0:17902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684358.141736:0:17902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684358.141737:0:17902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684358.141739:0:17902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684358.141740:0:17902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684358.141741:0:17902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684358.141743:0:17902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684358.141752:0:17902:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788684358.141768:0:17902:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00080000:0.0:1788684358.142003:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d677fa72a00 x1875571085843584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684358.142015:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684358.142022:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788684358.142032:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788684358.142037:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788684358.142040:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6646494000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788684358.142046:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085843584:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1788684358.142057:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788684358.157210:0:17902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788684358.157340:0:17927:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788684358.157344:0:17927:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788684358.157521:0:17928:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788684358.157843:0:17902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1788684358.158087:0:17928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684358.161968:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788684358.162073:0:17928:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788684358.162886:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17929:1875571085844352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788684358.162954:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684358.163001:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d675ebf4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684358.163055:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085844352 00000100:00100000:0.0:1788684358.163062:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085844352 00000100:00100000:0.0:1788684358.163111:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684358.163119:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17929:x1875571085844352:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788684358.163201:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17929:x1875571085844352:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684358.163209:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788684358.163526:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17929:1875571085844352:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788684358.163556:0:17929:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788684358.163584:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17929:1875571085844480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788684358.163615:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684358.163640:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d675ebf4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684358.163693:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085844480 00000100:00100000:1.0:1788684358.163697:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085844480 00000100:00100000:1.0:1788684358.163729:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788684358.163737:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17929:x1875571085844480:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788684358.163967:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17929:1875571085844480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788684358.164029:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17929:1875571085844608:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788684358.164058:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684358.164081:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d675ebf4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788684358.164134:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085844608 00000100:00100000:0.0:1788684358.164139:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085844608 00000100:00100000:0.0:1788684358.164172:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684358.164179:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17929:x1875571085844608:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788684358.164217:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17929:x1875571085844608:12345-0@lo:900:lod0001_rec0000.0 Request processed in 38us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684358.164231:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684358.164272:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17929:x1875571085844480:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.164289:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788684358.164757:0:17929:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d66479a4380 x1875571085844608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788684374 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684358.164768:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17929:1875571085844608:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788684358.164812:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17929:1875571085844736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788684358.164838:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684358.164870:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d675ebf4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684358.164961:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085844736 00000100:00100000:1.0:1788684358.164965:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085844736 00000100:00100000:1.0:1788684358.164997:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788684358.165005:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17929:x1875571085844736:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788684358.165067:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17929:x1875571085844736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 62us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684358.165074:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684358.165125:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17929:1875571085844736:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788684358.165167:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788684358.167131:0:17902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788684358.167173:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788684358.168279:0:17902:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788684358.168291:0:17902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788684358.168350:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684358.169076:0:17929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788684358.169154:0:17929:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788684358.169159:0:17929:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:2.0:1788684358.170703:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788684358.171582:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788684358.171627:0:17902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788684358.171790:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788684358.172297:0:17902:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1788684358.174064:0:17902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788684358.182616:0:17902:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788684358.182659:0:17902:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb81ec557f988 00100000:10000000:2.0:1788684358.182667:0:17902:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788684358.185046:0:17902:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788684358.185080:0:17902:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788684358.185097:0:17902:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788684358.185122:0:17902:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788684358.187065:0:17902:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788684358.187293:0:17902:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684358.398791:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684358.717977:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00000040:00080000:0.0:1788684359.169158:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788684359.422816:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684359.747699:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 10000000:01000000:2.0:1788684359.874271:0:17168:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788684359.874280:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d678003e800 from 8 10000000:01000000:2.0:1788684359.874284:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788684359.874330:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684359.874353:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684359.874378:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684359.874405:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085844864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684359.874470:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684359.874642:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684359.875513:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085844864 00000100:00100000:3.0:1788684359.875523:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085844864 00000100:00100000:2.0:1788684359.875762:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788684359.875784:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+16:17168:x1875571085844864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684359.875806:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684359.875825:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad60e expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684359.875849:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad60e expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684359.875859:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad60e expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684359.875867:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684359.875938:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085844864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684359.875953:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788684359.876051:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085844864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684359.876066:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684359.876075:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684359.876145:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085844992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788684359.876181:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684359.877360:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684359.877441:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085844992 00000100:00100000:3.0:1788684359.877449:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085844992 00000100:00100000:3.0:1788684359.877490:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788684359.877498:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085844992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788684359.877518:0:17164:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788684359.877536:0:17164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788684359.877540:0:17164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788684359.877650:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085844992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684359.877666:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788684359.880104:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085844992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788684359.880263:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684359.880274:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684359.880285:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684359.880295:0:17168:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684359.880297:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d66484cb800 from 8 10000000:01000000:0.0:1788684359.880300:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684359.880331:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684359.880345:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684359.880355:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684359.880452:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085845120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684359.880504:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684359.880532:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684359.880695:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085845120 00000100:00100000:3.0:1788684359.880701:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085845120 00000100:00100000:3.0:1788684359.880745:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788684359.880754:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085845120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684359.880766:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684359.880777:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad61c expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684359.880804:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad61c expref: 18 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684359.880815:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad61c expref: 18 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684359.880824:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c800, rc 0) 00000100:00100000:3.0:1788684359.880863:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:17168:x1875571085845120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684359.880871:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788684359.882137:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085845120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684359.882161:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684359.882172:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684359.882245:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085845248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788684359.882294:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684359.882326:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684359.882344:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085845248 00000100:00100000:0.0:1788684359.882349:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085845248 00000100:00100000:0.0:1788684359.882410:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788684359.882417:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17168:x1875571085845248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788684359.882435:0:17163:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788684359.882451:0:17163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788684359.882455:0:17163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788684359.882549:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17168:x1875571085845248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684359.882557:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788684359.882593:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085845248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788684359.882630:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684359.882637:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684359.882645:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684360.197752:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788684360.447011:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684360.766444:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00010000:00010000:0.0:1788684361.472074:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684361.793633:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00010000:00010000:2.0:1788684362.493677:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684362.815087:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 0 seconds 00000001:02000400:3.0:1788684362.992351:0:18172:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788684363.389513:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788684363.389519:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788684363.389523:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684363.389535:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d677487b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684363.389566:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa73b80 x1875571085845504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788684363.389588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684363.389592:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684363.389594:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684363.389597:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684363.389622:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684363.389626:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684363.389628:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684363.389632:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788684363.389665:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085845504:0@lo:38:kworker.0 00000100:00100000:1.0:1788684363.389742:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684363.389816:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085845760:0@lo:400:kworker.0 00000100:00100000:1.0:1788684363.389843:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684363.389861:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684363.389867:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085845888:0@lo:400:kworker.0 00000100:00100000:1.0:1788684363.389892:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684363.389922:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085845504 00000100:00100000:1.0:1788684363.389928:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085845504 00000100:00100000:1.0:1788684363.389953:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085845760 00000100:00100000:1.0:1788684363.389955:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085845760 00000100:00100000:1.0:1788684363.389992:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788684363.389999:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1875571085845504:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788684363.390023:0:17912:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1788684363.390063:0:17912:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ad62a 00000004:00100000:1.0:1788684363.390078:0:17912:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788684363.390084:0:17912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788684363.390095:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085845376:0@lo:400:kworker.0 00000100:00100000:2.0:1788684363.390135:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684363.390159:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684363.390168:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684363.390170:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085845760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684363.390177:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085845632:0@lo:400:kworker.0 00000100:00100000:2.0:1788684363.390206:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684363.390250:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085845760:12345-0@lo:400:kworker.0 Request processed in 81us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684363.390252:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085845376 00000100:00100000:2.0:1788684363.390257:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085845376 00000100:00100000:1.0:1788684363.390262:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788684363.390292:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085845888 00000100:00100000:2.0:1788684363.390294:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684363.390299:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085845888 00000100:00100000:2.0:1788684363.390303:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:3625:x1875571085845376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684363.390326:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085845632 00000100:00100000:1.0:1788684363.390330:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085845632 00000100:00100000:2.0:1788684363.390347:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:3625:x1875571085845376:12345-0@lo:400:kworker.0 Request processed in 44us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684363.390349:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684363.390362:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684363.390362:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085845888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684363.390433:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085845888:12345-0@lo:400:kworker.0 Request processed in 75us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684363.390440:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684363.390444:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085845376:0@lo:400:kworker.0 00000100:00100000:1.0:1788684363.390458:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788684363.390466:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085845632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684363.390506:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085845632:12345-0@lo:400:kworker.0 Request processed in 41us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684363.390512:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788684363.390547:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fa71f80 x1875571085845888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684363.390557:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085845888:0@lo:400:kworker.0 00000100:00100000:1.0:1788684363.390566:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085845760:0@lo:400:kworker.0 00010000:00080000:2.0:1788684363.390604:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fa71880 x1875571085845632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684363.390615:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085845632:0@lo:400:kworker.0 00000100:00100000:2.0:1788684363.391232:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085846016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684363.391266:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684363.391344:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085846016 00000100:00100000:3.0:1788684363.391349:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085846016 00000100:00100000:3.0:1788684363.391460:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684363.391469:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085846016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684363.391494:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788684363.391544:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085846016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684363.391558:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788684363.391673:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085846016:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788684363.409130:0:17912:0:(import.c:65:import_set_state_nolock()) ffff8d678003b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684363.409598:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875571085845504:12345-0@lo:38:kworker.0 Request processed in 19595us (19853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684363.409609:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788684363.409771:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788684363.409780:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788684363.409786:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788684363.409789:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788684363.409925:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007453f98e): req@ffff8d6648664700 x1875571085838464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684363.409951:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085845504:0@lo:38:kworker.0 00000100:00100000:3.0:1788684363.410063:0:17212:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684363.410096:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788684363.410136:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085838464 00000100:00100000:0.0:1788684363.410142:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085838464 00000100:00100000:0.0:1788684363.410192:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684363.410201:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17212:x1875571085838464:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788684363.410284:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17212:x1875571085838464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684363.410291:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684363.410332:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17212:1875571085838464:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788684363.410391:0:17212:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788684363.410431:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17212:1875571085846144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788684363.410461:0:17212:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684363.410483:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d4db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684363.410672:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085846144 00000100:00100000:3.0:1788684363.410678:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085846144 00000100:00100000:3.0:1788684363.410711:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788684363.410718:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17212:x1875571085846144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788684363.410812:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17212:x1875571085846144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684363.410819:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788684363.411016:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17212:1875571085846144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788684363.411082:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17212:1875571085846272:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788684363.411107:0:17212:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684363.411130:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d4db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684363.411143:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085846272 00000100:00100000:0.0:1788684363.411147:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085846272 00000100:00100000:0.0:1788684363.411165:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684363.411171:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17212:x1875571085846272:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788684363.411242:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17212:x1875571085846272:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684363.411249:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684363.411274:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17212:1875571085846272:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788684363.411311:0:17212:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788684363.416412:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684363.416433:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085846400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684363.416502:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684363.416558:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085846400 00000100:00100000:1.0:1788684363.416566:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085846400 00000100:00100000:1.0:1788684363.416612:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684363.416622:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085846400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684363.416670:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788684363.416722:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085846400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684363.416729:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684363.416772:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085846400:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788684363.417459:0:17212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788684363.417549:0:17212:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:0.0:1788684363.417555:0:17212:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788684363.517641:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788684364.022736:0:18224:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684364.022934:0:18224:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788684364.541674:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788684365.111042:0:18274:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684365.111244:0:18274:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788684365.568680:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788684366.345508:0:18322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff83db4a20 20000000:00000080:2.0:1788684366.345532:0:18322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d677e7f9400 uarg=0000000000000000 20000000:01000000:2.0:1788684366.345587:0:18322:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788684366.345596:0:18322:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788684366.345610:0:18322:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788684366.347097:0:18323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788684366.347294:0:18322:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788684366.371883:0:18322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788684366.371967:0:18322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.371991:0:18322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad4d3 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.372000:0:18322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad5d6 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.372008:0:18322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.374304:0:18322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad5d6 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.374336:0:18322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad5d6 expref: 17 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684366.374357:0:18322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18322:1875571085846528:0@lo:104: 00000100:00100000:3.0:1788684366.374939:0:18322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684366.375043:0:18322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad4d3 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.375055:0:18322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad4d3 expref: 17 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684366.375067:0:18322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18322:1875571085846656:0@lo:104: 00000100:00100000:3.0:1788684366.375105:0:18322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684366.375135:0:18322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742f85840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684366.375278:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085846528 00000100:00100000:0.0:1788684366.375288:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085846528 00000100:00100000:1.0:1788684366.375311:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085846656 00000100:00100000:1.0:1788684366.375315:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085846656 00000100:00100000:0.0:1788684366.375392:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684366.375402:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+4:18322:x1875571085846656:12345-0@lo:104: 00010000:00010000:0.0:1788684366.375419:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684366.375487:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684366.375493:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+4:18322:x1875571085846656:12345-0@lo:104: Request processed in 94us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684366.375500:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684366.375521:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684366.375527:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+3:18322:x1875571085846528:12345-0@lo:104: 00010000:00010000:0.0:1788684366.375535:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684366.375574:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788684366.375580:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+3:18322:x1875571085846528:12345-0@lo:104: Request processed in 54us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684366.375586:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788684366.375597:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684366.375605:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.375613:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891600 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684366.375618:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.375628:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684366.375647:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684366.375654:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684366.375698:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.375705:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684366.375726:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.375733:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647891600/0x44bac02bd54ad4d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad4da expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684366.375777:0:18322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18322:1875571085846528:0@lo:104: 00000100:00100000:3.0:1788684366.375786:0:18322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18322:1875571085846656:0@lo:104: 00010000:00010000:3.0:1788684366.375811:0:18322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.376065:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684366.376070:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.376077:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684366.376080:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.376095:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684366.376102:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684366.376107:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788684366.376136:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.376142:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684366.376149:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.376156:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647891e00/0x44bac02bd54ad5d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad5dd expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.376172:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684366.376174:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684366.376176:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684366.376304:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684366.376321:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085846784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684366.376404:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684366.376506:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684366.376512:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085846912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684366.376537:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684366.376896:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085846784 00000100:00100000:2.0:1788684366.376903:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085846784 00010000:00010000:2.0:1788684366.376935:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad4d3 expref: 18 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684366.377012:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085846912 00000100:00100000:2.0:1788684366.377016:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085846912 00010000:00010000:2.0:1788684366.377030:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad5d6 expref: 19 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684366.377043:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684366.377050:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+19:3623:x1875571085846784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684366.377066:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684366.377073:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad4d3 expref: 19 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.377096:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad4d3 expref: 19 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.377113:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647890e00/0x44bac02bd54ad4da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad4d3 expref: 19 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.377127:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684366.377170:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+18:3623:x1875571085846784:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684366.377177:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684366.377194:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788684366.377200:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+17:3623:x1875571085846912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684366.377209:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684366.377213:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad5d6 expref: 17 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378070:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad5d6 expref: 17 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684366.378081:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085846784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684366.378083:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad5dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad5d6 expref: 17 pid: 17165 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378098:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378107:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378126:0:17158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378143:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378151:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378158:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378164:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684366.378170:0:17158:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378180:0:17158:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.378206:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.378263:0:18322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.378279:0:18322:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684366.378286:0:18322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad631 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684366.379331:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684366.380050:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+16:3623:x1875571085846912:12345-0@lo:103:ldlm_bl.0 Request processed in 2841us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684366.380064:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684366.380137:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085846912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684366.590560:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788684366.910191:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788684367.614477:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788684367.677653:0:17168:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684367.677665:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d678003e800 from 13 10000000:01000000:0.0:1788684367.677673:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684367.677736:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684367.677750:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684367.677779:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684367.677823:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684367.677911:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684367.677986:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67770fbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684367.678201:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085847040 00000100:00100000:1.0:1788684367.678212:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085847040 00000100:00100000:1.0:1788684367.678994:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788684367.679012:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fadb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+16:17168:x1875571085847040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684367.679035:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684367.679062:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad638 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684367.679099:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad638 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684367.679113:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad638 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684367.679123:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0600, rc 0) 00000100:00100000:1.0:1788684367.679218:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fadb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085847040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684367.679227:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788684367.683088:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684367.683134:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684367.683149:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684367.683955:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684367.684041:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684367.684099:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746d133c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684367.684124:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085847168 00000100:00100000:1.0:1788684367.684132:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085847168 00000100:00100000:1.0:1788684367.684194:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788684367.684206:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085847168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684367.684389:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085847168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684367.684399:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788684367.684462:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684367.684500:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684367.684549:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684367.684565:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746d133c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684367.684578:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085847296 00000100:00100000:1.0:1788684367.684582:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085847296 00000100:00100000:1.0:1788684367.684606:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788684367.684612:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085847296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684367.684696:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085847296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684367.684703:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788684367.684748:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788684367.687054:0:18379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788684367.687884:0:17168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788684367.687995:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788684367.688011:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684367.688026:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684367.688038:0:17168:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788684367.688041:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d66484cb800 from 13 10000000:01000000:3.0:1788684367.688044:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788684367.688095:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684367.688103:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684367.688115:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684367.688148:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788684367.688311:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684367.688596:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684367.689154:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085847424 00000100:00100000:1.0:1788684367.689177:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085847424 00000100:00100000:0.0:1788684367.689352:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788684367.689386:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+17:17168:x1875571085847424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684367.689406:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684367.689424:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad646 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684367.689465:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad646 expref: 18 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684367.689477:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad646 expref: 18 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684367.689487:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891a00, rc 0) 00000100:00100000:0.0:1788684367.689553:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:17168:x1875571085847424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684367.689560:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788684367.689726:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684367.689747:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684367.689759:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684367.689885:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684367.689921:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684367.689970:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d28000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684367.690121:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085847552 00000100:00100000:0.0:1788684367.690126:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085847552 00000100:00100000:0.0:1788684367.690160:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788684367.690177:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:17168:x1875571085847552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684367.690320:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:17168:x1875571085847552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684367.690328:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788684367.690554:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684367.690590:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684367.690633:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684367.690655:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d28000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684367.690696:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085847680 00000100:00100000:0.0:1788684367.690700:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085847680 00000100:00100000:0.0:1788684367.690730:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788684367.690738:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fadb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:17168:x1875571085847680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684367.690941:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fadb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:17168:x1875571085847680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684367.690949:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788684367.691080:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085847680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788684367.692626:0:18381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788684367.697559:0:17168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788684367.697612:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684367.697629:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684367.697644:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684368.509559:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684368.509591:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085847808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684368.509675:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684368.509841:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085847808 00000100:00100000:0.0:1788684368.509851:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085847808 00000100:00100000:0.0:1788684368.509919:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684368.509940:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085847808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684368.509985:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788684368.510052:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085847808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684368.510060:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684368.510090:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085847808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684368.510272:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684358/real 1788684358] req@ffff8d66479a4700 x1875571085841792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684368.510294:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a4700 x1875571085841792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684368.510304:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684358/real 1788684358] req@ffff8d66479a5f80 x1875571085841536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684368.510316:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a5f80 x1875571085841536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788684368.510342:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684368.510388:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788684368.510392:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085841792:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788684368.510399:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664773f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684368.510408:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788684368.510411:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085841536:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788684368.510441:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788684368.510441:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085848064:0@lo:400:kworker.0 00000100:00080000:2.0:1788684368.510446:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684368.510449:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684368.510459:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684368.510472:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684368.510475:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788684368.510477:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d664773f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684368.510482:0:14645:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 439 00000100:00100000:0.0:1788684368.510486:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684368.510488:0:14645:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788684368.510493:0:14645:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d664773f000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684368.510507:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788684368.510512:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876e300 x1875571085848320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684368.510512:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085848192:0@lo:400:kworker.0 00000100:00080000:2.0:1788684368.510525:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684368.510527:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788684368.510529:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684368.510533:0:14645:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 439 00000100:00080000:2.0:1788684368.510535:0:14645:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1788684368.510535:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684368.510539:0:14645:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d6775fa6000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684368.510560:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085848064 00000100:00100000:0.0:1788684368.510566:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085848064 00000100:00100000:2.0:1788684368.510567:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876c000 x1875571085848448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684368.510591:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684368.510594:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684368.510596:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684368.510598:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684368.510614:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085847936:0@lo:400:kworker.0 00000100:00100000:2.0:1788684368.510647:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684368.510683:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684368.510689:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085848576:0@lo:400:kworker.0 00000100:00100000:2.0:1788684368.510717:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684368.510725:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788684368.510733:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085848064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684368.510742:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085847936 00000100:00100000:2.0:1788684368.510746:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085847936 00000100:00100000:0.0:1788684368.510773:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085848064:12345-0@lo:400:kworker.0 Request processed in 40us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684368.510780:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788684368.511019:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788684368.511027:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:3626:x1875571085847936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684368.511063:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+18:3626:x1875571085847936:12345-0@lo:400:kworker.0 Request processed in 38us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684368.511070:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788684368.511101:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085848192 00000100:00100000:2.0:1788684368.511105:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085848192 00000100:00100000:2.0:1788684368.511127:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085848576 00000100:00100000:2.0:1788684368.511129:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085848576 00000100:00100000:2.0:1788684368.511140:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788684368.511145:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085848192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684368.511221:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788684368.511230:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788684368.511248:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085848192:12345-0@lo:400:kworker.0 Request processed in 102us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684368.511255:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788684368.511270:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684368.511275:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085848576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684368.511298:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085848576:12345-0@lo:400:kworker.0 Request processed in 23us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684368.511303:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788684368.511334:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d664876ed80 x1875571085848576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684368.511345:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085848576:0@lo:400:kworker.0 00000100:00100000:2.0:1788684368.511362:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085847936:0@lo:400:kworker.0 00010000:00080000:0.0:1788684368.511386:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d664876df80 x1875571085848192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684368.511397:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085848192:0@lo:400:kworker.0 00000100:00100000:0.0:1788684368.511408:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085848064:0@lo:400:kworker.0 00000100:00100000:0.0:1788684368.511436:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085848320:0@lo:8:kworker.0 00000400:00000100:0.0:1788684368.511530:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085848320 offset 0 length 520: 4 00000100:00100000:0.0:1788684368.511551:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085848448:0@lo:8:kworker.0 00000400:00000100:0.0:1788684368.511566:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085848448 offset 0 length 520: 4 00000100:00100000:1.0:1788684368.515447:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684368.515473:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085848704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684368.515564:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684368.517515:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085848704 00000100:00100000:2.0:1788684368.517533:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085848704 00000100:00100000:2.0:1788684368.517598:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684368.517610:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085848704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684368.517662:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788684368.517764:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085848704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684368.517773:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684368.517848:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085848704:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788684368.651162:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788684369.023431:0:17903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788684369.536740:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684354/real 1788684354] req@ffff8d66479a5180 x1875571085839616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684369.536782:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a5180 x1875571085839616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684369.536803:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684354/real 1788684354] req@ffff8d66479a4000 x1875571085839488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684369.536817:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a4000 x1875571085839488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788684369.536838:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf25000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684369.536866:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788684369.536871:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085839616:0@lo:8:kworker.0 00000100:00080000:1.0:1788684369.536877:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf21800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684369.536881:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788684369.536885:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085839488:0@lo:8:kworker.0 00000100:00080000:3.0:1788684369.537083:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684369.537088:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788684369.537092:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d677cf21800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684369.537098:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1788684369.537104:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788684369.537111:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d677cf21800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684369.537136:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a4000 x1875571085849088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684369.537148:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684369.537151:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788684369.537153:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d677cf25000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684369.537156:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1788684369.537159:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788684369.537163:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d677cf25000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684369.537174:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a5180 x1875571085849216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684369.537210:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684369.537214:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684369.537218:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684369.537221:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788684369.537250:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085849472:0@lo:400:kworker.0 00000100:00100000:3.0:1788684369.537332:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684369.537410:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684369.537417:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085849344:0@lo:400:kworker.0 00000100:00100000:3.0:1788684369.537453:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684369.537489:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085849472 00000100:00100000:3.0:1788684369.537497:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085849472 00000100:00100000:3.0:1788684369.537549:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788684369.537559:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085849472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684369.537619:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085849472:12345-0@lo:400:kworker.0 Request processed in 62us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684369.537627:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788684369.537672:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085849472:0@lo:400:kworker.0 00000100:00100000:1.0:1788684369.537819:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085848832:0@lo:400:kworker.0 00000100:00100000:1.0:1788684369.537863:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684369.537905:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085849600:0@lo:400:kworker.0 00000100:00100000:1.0:1788684369.537944:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684369.537970:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684369.537976:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085848960:0@lo:400:kworker.0 00000100:00100000:1.0:1788684369.538122:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684369.538156:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085849344 00000100:00100000:1.0:1788684369.538161:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085849344 00000100:00100000:1.0:1788684369.538198:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085849600 00000100:00100000:1.0:1788684369.538210:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085849600 00000100:00100000:1.0:1788684369.538242:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788684369.538249:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085849344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684369.538290:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085849344:12345-0@lo:400:kworker.0 Request processed in 42us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684369.538297:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788684369.538311:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788684369.538316:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085849600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684369.538347:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085849600:12345-0@lo:400:kworker.0 Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684369.538353:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788684369.538397:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085848960 00000100:00100000:1.0:1788684369.538401:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085848960 00000100:00100000:1.0:1788684369.538426:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788684369.538433:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085848960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684369.538466:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085848960:12345-0@lo:400:kworker.0 Request processed in 34us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684369.538472:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788684369.538501:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085849088:0@lo:8:kworker.0 00000400:00000100:1.0:1788684369.538530:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085849088 offset 0 length 520: 4 00000100:00100000:1.0:1788684369.538546:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085849216:0@lo:8:kworker.0 00000400:00000100:1.0:1788684369.538563:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085849216 offset 0 length 520: 4 00000100:00100000:1.0:1788684369.538597:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085848960:0@lo:400:kworker.0 00010000:00080000:1.0:1788684369.538610:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d66479a5880 x1875571085849600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684369.538637:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085849600:0@lo:400:kworker.0 00010000:00080000:1.0:1788684369.538675:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d66479a5f80 x1875571085849344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684369.538685:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085849344:0@lo:400:kworker.0 00000100:00100000:3.0:1788684369.538764:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085848832 00000100:00100000:3.0:1788684369.538769:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085848832 00000100:00100000:3.0:1788684369.538822:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788684369.538831:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+18:3623:x1875571085848832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684369.538870:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+18:3623:x1875571085848832:12345-0@lo:400:kworker.0 Request processed in 42us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684369.538877:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788684369.539029:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085848832:0@lo:400:kworker.0 00010000:00010000:1.0:1788684369.661545:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788684370.431082:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788684370.685795:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684371.711502:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684372.736128:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684373.630806:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788684373.630846:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085849728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684373.630961:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684373.631042:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085849728 00000100:00100000:2.0:1788684373.631051:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085849728 00000100:00100000:2.0:1788684373.631119:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788684373.631129:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085849728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684373.631170:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788684373.631320:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085849856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684373.632650:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085849728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684373.634331:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684373.634437:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085849856 00000100:00100000:3.0:1788684373.634447:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085849856 00000100:00100000:3.0:1788684373.634497:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684373.634508:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085849856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684373.634553:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788684373.634629:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085849856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684373.634637:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684373.634686:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085849856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684373.638275:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085849728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7131us (7298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684373.638295:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788684373.781314:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788684374.243273:0:18673:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788684374.243276:0:18673:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788684374.243278:0:18673:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788684374.243441:0:18673:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d677fabb800 00000020:01000004:2.0:1788684374.243456:0:18673:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788684374.243469:0:18673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788684374.243490:0:18673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d677e144d40) 00000020:00000080:2.0:1788684374.243524:0:18673:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788684374.360468:0:18673:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788684374.361546:0:18673:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788684374.362233:0:18673:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788684374.363351:0:18673:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788684374.363780:0:18673:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788684374.364498:0:18673:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788684374.364992:0:18673:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788684374.371459:0:18673:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788684374.372181:0:18673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788684374.372195:0:18673:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788684374.372209:0:18673:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x44bac02bd54ad65b 00000020:01000004:2.0:1788684374.372217:0:18673:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788684374.372240:0:18673:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788684374.372243:0:18673:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788684374.372249:0:18673:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788684374.372254:0:18673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788684374.372266:0:18673:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d677e140000) 00000020:00000080:2.0:1788684374.372279:0:18673:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788684374.373459:0:18673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684374.373627:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788684374.373633:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788684374.377420:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788684374.377435:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788684374.377820:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788684374.377827:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788684374.387180:0:18673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684374.390501:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788684374.390513:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788684374.391911:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788684374.391921:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788684374.434921:0:18673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788684374.435161:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788684374.435167:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788684374.440671:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788684374.440691:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788684374.441894:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788684374.441918:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788684374.450946:0:18673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684374.451143:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788684374.451149:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788684374.459640:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788684374.459656:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788684374.495023:0:18673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684374.495230:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788684374.495237:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788684374.496650:0:18673:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788684374.496660:0:18673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788684374.497135:0:18673:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788684374.497161:0:18673:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788684374.497166:0:18673:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788684374.516066:0:18673:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788684374.516102:0:18673:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788684374.516106:0:18673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788684374.516108:0:18673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788684374.516109:0:18673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684374.516111:0:18673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684374.516112:0:18673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684374.516113:0:18673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684374.516115:0:18673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684374.516116:0:18673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684374.516117:0:18673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788684374.516120:0:18673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788684374.516123:0:18673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684374.516124:0:18673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788684374.516125:0:18673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684374.516126:0:18673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684374.516127:0:18673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684374.516128:0:18673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684374.516129:0:18673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684374.516130:0:18673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684374.516131:0:18673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788684374.516154:0:18673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788684374.516172:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085849984:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788684374.516249:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684374.516404:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684374.516760:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085849984 00000100:00100000:0.0:1788684374.516837:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085849984 00000100:00100000:1.0:1788684374.517091:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788684374.517103:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:18673:x1875571085849984:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788684374.517135:0:17164:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788684374.517139:0:17164:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788684374.517142:0:17164:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788684374.517487:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+18:18673:x1875571085849984:12345-0@lo:253:mount.lustre.0 Request processed in 385us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684374.517496:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788684374.517590:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085849984:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788684374.517603:0:18673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788684374.517606:0:18673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788684374.517608:0:18673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788684374.517610:0:18673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684374.517611:0:18673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684374.517612:0:18673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684374.517613:0:18673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684374.517615:0:18673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788684374.517616:0:18673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684374.517618:0:18673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788684374.517638:0:18673:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d677fabb800 from lustre-OST0000 10000000:01000000:0.0:1788684374.517668:0:18673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788684374.517671:0:18673:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788684374.517680:0:18673:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d677e3eb380 local copy 00010000:00010000:0.0:1788684374.517690:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684374.517796:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684374.517840:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684374.518354:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684374.518742:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085850112 00000100:00100000:3.0:1788684374.518749:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085850112 00000100:00100000:0.0:1788684374.518920:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788684374.518939:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+18:18673:x1875571085850112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684374.519034:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+18:18673:x1875571085850112:12345-0@lo:501:mount.lustre.0 Request processed in 97us (1195us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788684374.519042:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788684374.519196:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850112:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788684374.519214:0:18673:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788684374.519240:0:18673:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788684374.519248:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684374.519258:0:18673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684374.519286:0:18673:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d677fabb800 10000000:01000000:3.0:1788684374.519291:0:18673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788684374.519297:0:18673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788684374.519312:0:18673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788684374.519316:0:18673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788684374.519319:0:18673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788684374.519346:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684374.519354:0:18673:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684374.519393:0:18673:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684374.519411:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684374.519442:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684374.519487:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684374.519704:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085850240 00000100:00100000:0.0:1788684374.519711:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085850240 00000100:00100000:0.0:1788684374.519731:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788684374.519737:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+18:18673:x1875571085850240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684374.519746:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684374.519757:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647890600/0x44bac02bd54ad670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad669 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684374.519790:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647890600/0x44bac02bd54ad670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad669 expref: 19 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684374.519800:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647890600/0x44bac02bd54ad670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad669 expref: 19 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684374.519808:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890600, rc 0) 00000100:00100000:0.0:1788684374.519848:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850240:12345-0@lo:101:mount.lustre.0 Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684374.519853:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788684374.520040:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684374.520053:0:18673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684374.520061:0:18673:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788684374.522025:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788684374.522689:0:18673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684374.525659:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788684374.525716:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788684374.525732:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788684374.525746:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788684374.525792:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788684374.525809:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788684374.525836:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788684374.525843:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788684374.526130:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684374.526193:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684374.526237:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684374.526313:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085850368 00000100:00100000:1.0:1788684374.526320:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085850368 00000100:00100000:1.0:1788684374.526383:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788684374.526394:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850368:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684374.526745:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850368:12345-0@lo:501:mount.lustre.0 Request processed in 351us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684374.526754:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788684374.527058:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684374.527094:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684374.527143:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684374.527174:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684374.527243:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085850496 00000100:00100000:1.0:1788684374.527254:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085850496 00000100:00100000:1.0:1788684374.527287:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788684374.527294:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850496:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684374.528312:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850496:12345-0@lo:503:mount.lustre.0 Request processed in 1005us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684374.528322:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788684374.528711:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850496:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788684374.529166:0:18673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788684374.529239:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684374.529295:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684374.529415:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684374.529823:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085850624 00000100:00100000:2.0:1788684374.529830:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085850624 00000100:00100000:0.0:1788684374.529931:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788684374.529943:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684374.530483:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850624:12345-0@lo:502:mount.lustre.0 Request processed in 540us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684374.530492:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788684374.530785:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788684374.531000:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788684374.531030:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788684374.531046:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788684374.531061:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788684374.531076:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788684374.531091:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788684374.531104:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788684374.531117:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788684374.531128:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788684374.531140:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788684374.531155:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788684374.531183:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788684374.531212:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684374.531255:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684374.531289:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001780 going to sleep for 11 seconds 00000100:00100000:1.0:1788684374.531507:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085850752 00000100:00100000:1.0:1788684374.531513:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085850752 00000100:00100000:1.0:1788684374.531555:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788684374.531563:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684374.531658:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850752:12345-0@lo:502:mount.lustre.0 Request processed in 95us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684374.531666:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788684374.532241:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684374.533145:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788684374.533160:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788684374.537212:0:18690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788684374.537223:0:18690:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788684374.537230:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684374.537232:0:18690:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788684374.537238:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788684374.537253:0:18690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d677e3e8000) 00000020:00000080:1.0:1788684374.537277:0:18690:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788684374.537283:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788684374.537656:0:18690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d677fabb800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788684374.537666:0:18690:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788684374.537673:0:18690:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x44bac02bd54ad67e 00010000:00010000:1.0:1788684374.548260:0:18690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788684374.549297:0:18690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788684374.552860:0:18690:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788684374.556834:0:18690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788684374.556847:0:18690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684374.556860:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684374.556863:0:18690:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788684374.556868:0:18690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788684374.556870:0:18690:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788684374.556871:0:18690:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788684374.556873:0:18690:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788684374.556875:0:18690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788684374.556877:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684374.556878:0:18690:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788684374.556880:0:18690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684374.556883:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684374.556884:0:18690:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788684374.556887:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788684374.556889:0:18690:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788684374.556891:0:18690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684374.556893:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684374.556894:0:18690:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788684374.556896:0:18690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684374.556913:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684374.556914:0:18690:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788684374.556918:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788684374.557148:0:18690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684374.557153:0:18690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684374.557154:0:18690:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788684374.557158:0:18690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788684374.557750:0:18673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788684374.557794:0:18673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788684374.557814:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684374.557825:0:18673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684374.557833:0:18673:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677fabb800 from 1 10000000:01000000:3.0:1788684374.557843:0:18673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788684374.557878:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684374.557886:0:18673:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684374.557897:0:18673:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684374.558172:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684374.558235:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684374.558276:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001780 going to sleep for 11 seconds 00000100:00100000:0.0:1788684374.558428:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085850880 00000100:00100000:0.0:1788684374.558436:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085850880 00000100:00100000:0.0:1788684374.558488:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788684374.558497:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+19:18673:x1875571085850880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684374.558510:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684374.558523:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad685 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684374.559410:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad685 expref: 20 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684374.559423:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad685 expref: 20 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684374.559433:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891600, rc 0) 00000100:00100000:0.0:1788684374.559495:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085850880:12345-0@lo:101:mount.lustre.0 Request processed in 998us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684374.559502:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788684374.560226:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085850880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684374.560244:0:18673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.560254:0:18673:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684374.562873:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788684374.563274:0:18673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684374.563632:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788684374.563658:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788684374.563678:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788684374.563683:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788684374.563877:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684374.564076:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684374.564166:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745d43540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684374.564221:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085851008 00000100:00100000:1.0:1788684374.564234:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085851008 00000100:00100000:1.0:1788684374.564424:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788684374.564434:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085851008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684374.564557:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085851008:12345-0@lo:501:mount.lustre.0 Request processed in 124us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684374.564566:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788684374.564640:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684374.564671:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684374.564710:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684374.565119:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085851136 00000100:00100000:2.0:1788684374.565125:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085851136 00000100:00100000:2.0:1788684374.565149:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788684374.565156:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085851136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788684374.565232:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085851136:12345-0@lo:503:mount.lustre.0 Request processed in 75us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684374.565238:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788684374.565424:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745d43540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684374.565439:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851136:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788684374.565812:0:18673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788684374.565873:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684374.565923:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684374.565968:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742f859c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684374.566130:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085851264 00000100:00100000:2.0:1788684374.566135:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085851264 00000100:00100000:2.0:1788684374.566167:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788684374.566174:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085851264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684374.566252:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085851264:12345-0@lo:502:mount.lustre.0 Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684374.566259:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788684374.566630:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684374.566813:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788684374.566839:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788684374.566854:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788684374.566884:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788684374.566912:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788684374.567131:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788684374.567151:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788684374.567165:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788684374.567178:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788684374.567193:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788684374.567207:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788684374.567231:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684374.567275:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684374.567298:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742f859c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684374.567354:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085851392 00000100:00100000:2.0:1788684374.567360:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085851392 00000100:00100000:2.0:1788684374.567410:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788684374.567417:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085851392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684374.567508:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085851392:12345-0@lo:502:mount.lustre.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684374.567515:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788684374.567566:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684374.567609:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788684374.567617:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788684374.568714:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684374.568857:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684374.568860:0:18694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788684374.568868:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d677fabb800 00000020:00000080:0.0:1788684374.568870:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684374.568878:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684374.568880:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684374.568881:0:18694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788684374.568883:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684374.568885:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684374.568886:0:18694:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788684374.568889:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d677fabb800 00000020:00000080:0.0:1788684374.568891:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684374.569080:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684374.569084:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684374.569085:0:18694:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788684374.569088:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684374.569091:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684374.569092:0:18694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684374.569096:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d677fabb800 00000020:00000080:0.0:1788684374.569097:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684374.569125:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684374.569128:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684374.569129:0:18694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684374.569132:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684374.569135:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684374.569136:0:18694:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788684374.569139:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d677fabb800 00000020:00000080:0.0:1788684374.569141:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684374.569164:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684374.569168:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684374.569169:0:18694:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788684374.569172:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788684374.569623:0:18673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788684374.569651:0:18673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788684374.569668:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.569679:0:18673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684374.570054:0:18673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788684374.570058:0:18673:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d677fabb800 10000000:01000000:1.0:1788684374.570061:0:18673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d677fabb800 10000000:01000000:1.0:1788684374.570066:0:18673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788684374.570072:0:18673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d677fabb800 from 1 10000000:01000000:1.0:1788684374.570074:0:18673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788684374.570107:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.570116:0:18673:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.570126:0:18673:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684374.570147:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788684374.570203:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684374.570272:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742f859c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684374.570996:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085851520 00000100:00100000:0.0:1788684374.571004:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085851520 00000100:00100000:0.0:1788684374.571119:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788684374.571200:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+20:18673:x1875571085851520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684374.571214:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684374.571229:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad69a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad693 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684374.571252:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad693 expref: 21 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684374.571568:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad693 expref: 21 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684374.571577:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891e00, rc 0) 00000100:00100000:0.0:1788684374.571629:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085851520:12345-0@lo:101:mount.lustre.0 Request processed in 501us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684374.576913:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788684374.577082:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684374.577107:0:18673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.577121:0:18673:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788684374.584581:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788684374.585709:0:18673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684374.586454:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788684374.586487:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788684374.586501:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788684374.586514:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788684374.586528:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788684374.586684:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788684374.586711:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788684374.586851:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788684374.586866:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788684374.586881:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788684374.586896:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788684374.587417:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788684374.587438:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788684374.587450:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788684374.587462:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788684374.587476:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788684374.587490:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788684374.587502:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788684374.587515:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788684374.587528:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788684374.587874:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788684374.587890:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788684374.588839:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788684374.588864:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788684374.588879:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788684374.588893:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788684374.588937:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788684374.588962:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788684374.588977:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788684374.589002:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788684374.589017:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788684374.589031:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788684374.589044:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788684374.589057:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788684374.589071:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788684374.589084:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788684374.589096:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788684374.589122:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788684374.589128:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788684374.589561:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684374.589622:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684374.589645:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085851648 00000100:00100000:2.0:1788684374.589651:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085851648 00000100:00100000:1.0:1788684374.589657:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317240 going to sleep for 11 seconds 00000100:00100000:2.0:1788684374.589699:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788684374.589708:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085851648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684374.590594:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085851648:12345-0@lo:501:mount.lustre.0 Request processed in 883us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684374.590605:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788684374.590626:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684374.590663:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684374.590702:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684374.590731:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684374.590879:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085851776 00000100:00100000:0.0:1788684374.590891:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085851776 00000100:00100000:0.0:1788684374.591074:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788684374.591083:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085851776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684374.591179:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085851776:12345-0@lo:503:mount.lustre.0 Request processed in 98us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684374.591187:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788684374.591270:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851776:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788684374.596437:0:18673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788684374.596546:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684374.596624:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684374.596657:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085851904 00000100:00100000:2.0:1788684374.596664:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085851904 00000100:00100000:0.0:1788684374.596667:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800afa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684374.596707:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788684374.596717:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085851904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684374.597273:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085851904:12345-0@lo:502:mount.lustre.0 Request processed in 556us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684374.597282:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788684374.598827:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085851904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684374.602147:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788684374.602215:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788684374.602234:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788684374.602248:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788684374.602261:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788684374.602274:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788684374.602290:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788684374.603212:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788684374.603241:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788684374.603252:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788684374.603263:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788684374.603273:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788684374.603283:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788684374.603295:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788684374.603844:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788684374.603868:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788684374.603913:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788684374.604272:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788684374.604564:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788684374.604586:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788684374.604601:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788684374.604613:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788684374.604626:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788684374.604639:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788684374.604653:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788684374.604666:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788684374.604679:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788684374.604690:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788684374.604701:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788684374.606320:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788684374.606413:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788684374.606433:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788684374.606469:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788684374.606487:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788684374.606499:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788684374.606512:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788684374.606526:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788684374.606540:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788684374.606554:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788684374.606567:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788684374.606580:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788684374.606595:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788684374.606608:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788684374.606619:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788684374.606630:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788684374.606641:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788684374.606652:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788684374.606663:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788684374.606725:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085852032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684374.606794:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684374.606841:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800afa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684374.606934:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085852032 00000100:00100000:3.0:1788684374.606941:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085852032 00000100:00100000:3.0:1788684374.606988:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788684374.606998:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085852032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684374.607143:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085852032:12345-0@lo:502:mount.lustre.0 Request processed in 134us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684374.607151:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788684374.607278:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085852032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684374.612355:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788684374.612436:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788684374.612500:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085852160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684374.612586:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684374.612631:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800afa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684374.613486:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085852160 00000100:00100000:3.0:1788684374.613495:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085852160 00000100:00100000:3.0:1788684374.613546:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788684374.613556:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085852160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684374.613680:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085852160:12345-0@lo:502:mount.lustre.0 Request processed in 124us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684374.613687:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788684374.613692:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085852160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684374.613775:0:18673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788684374.613788:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788684374.617688:0:18700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788684374.617705:0:18700:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d67482e4d40) 00000020:00000080:0.0:1788684374.617739:0:18700:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788684374.617844:0:18700:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d677fabb800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788684374.617848:0:18700:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d677fabb800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788684374.617850:0:18700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677fabb800 3 00010000:00080000:0.0:1788684374.617878:0:18700:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6646cc0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684374.623875:0:18700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788684374.624089:0:18700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788684374.624151:0:18700:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788684374.624166:0:18700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x44bac02bd54ad6a8 00000100:00080000:3.0:1788684374.624176:0:18700:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684374.624182:0:18700:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d6646cc0800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684374.624215:0:18700:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a5880 x1875571085852288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684374.624234:0:18700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788684374.624284:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684374.624289:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684374.624291:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684374.624294:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684374.624314:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684374.624317:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684374.624320:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684374.624322:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788684374.624358:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085852416:0@lo:400:kworker.0 00000100:00100000:3.0:1788684374.624443:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684374.624478:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684374.624484:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085852800:0@lo:400:kworker.0 00000100:00100000:3.0:1788684374.624511:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684374.624552:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085852416 00000100:00100000:3.0:1788684374.624558:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085852416 00000100:00100000:3.0:1788684374.624593:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684374.624607:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085852416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684374.624660:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085852416:12345-0@lo:400:kworker.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684374.624667:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684374.624692:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085852800 00000100:00100000:3.0:1788684374.624696:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085852800 00000100:00100000:3.0:1788684374.624723:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684374.624729:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085852800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684374.624759:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085852800:12345-0@lo:400:kworker.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684374.624764:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788684374.624798:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fbc1880 x1875571085852800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684374.624813:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085852800:0@lo:400:kworker.0 00000100:00100000:3.0:1788684374.624826:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085852416:0@lo:400:kworker.0 00000100:00100000:0.0:1788684374.625475:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085852288:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788684374.625528:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684374.625586:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085852544:0@lo:400:kworker.0 00000100:00100000:0.0:1788684374.625615:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684374.625636:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684374.625644:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085852672:0@lo:400:kworker.0 00000100:00100000:0.0:1788684374.625672:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684374.625706:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085852672 00000100:00100000:0.0:1788684374.625711:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085852672 00000100:00100000:0.0:1788684374.625744:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788684374.625773:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085852672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684374.625819:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085852672:12345-0@lo:400:kworker.0 Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684374.625826:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788684374.625851:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085852288 00000100:00100000:0.0:1788684374.625854:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085852288 00000100:00100000:0.0:1788684374.625870:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085852544 00000100:00100000:0.0:1788684374.625872:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085852544 00000100:00100000:0.0:1788684374.625891:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684374.625896:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085852544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684374.625939:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085852544:12345-0@lo:400:kworker.0 Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684374.625946:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684374.625958:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684374.625962:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085852288:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788684374.625982:0:17172:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1788684374.626015:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x44bac02bd54ad6af 00000004:00100000:0.0:1788684374.626030:0:17172:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788684374.626246:0:17172:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684374.626290:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875571085852288:12345-0@lo:38:llog_process_th.0 Request processed in 326us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684374.626297:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684374.626339:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085852672:0@lo:400:kworker.0 00010000:00080000:0.0:1788684374.626352:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d66479a5f80 x1875571085852544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684374.626361:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085852544:0@lo:400:kworker.0 00010000:00080000:0.0:1788684374.626425:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d66479a5880 x1875571085852288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684374.626432:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684374.626438:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788684374.626444:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788684374.626448:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788684374.626450:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788684374.626454:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085852288:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788684374.631030:0:18700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788684374.631058:0:18700:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d6746c04d40) 00000020:00000080:3.0:1788684374.631082:0:18700:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788684374.631177:0:18700:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d677fabb800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788684374.631181:0:18700:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d677fabb800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788684374.631184:0:18700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677fabb800 3 00010000:00080000:3.0:1788684374.631210:0:18700:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6646cce800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684374.634014:0:18700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788684374.634233:0:18700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788684374.634276:0:18700:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788684374.634287:0:18700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x44bac02bd54ad6bd 00000100:00080000:3.0:1788684374.634297:0:18700:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684374.634309:0:18700:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d6646cce800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684374.634341:0:18700:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fbc1880 x1875571085852928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684374.634402:0:18700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788684374.634440:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684374.634444:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684374.634447:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684374.634450:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684374.634453:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684374.634456:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684374.634459:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788684374.634461:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788684374.635316:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085852928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788684374.635411:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684374.635599:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085852928 00000100:00100000:1.0:1788684374.635606:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085852928 00000100:00100000:1.0:1788684374.635636:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788684374.635643:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085852928:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788684374.635668:0:17172:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:1.0:1788684374.635698:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x44bac02bd54ad6c4 00000004:00100000:1.0:1788684374.635712:0:17172:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788684374.635741:0:17172:0:(import.c:65:import_set_state_nolock()) ffff8d66459ab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684374.635796:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875571085852928:12345-0@lo:38:llog_process_th.0 Request processed in 153us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684374.635811:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788684374.636006:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fbc1880 x1875571085852928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684374.636016:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684374.636023:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788684374.636030:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788684374.636034:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788684374.636037:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6646cce800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788684374.636042:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085852928:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788684374.637214:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788684374.637703:0:18673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788684374.637733:0:18673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788684374.637795:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.637807:0:18673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788684374.637860:0:18673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788684374.637862:0:18673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788684374.637864:0:18673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684374.637865:0:18673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684374.637866:0:18673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684374.637867:0:18673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684374.637868:0:18673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684374.637870:0:18673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684374.637871:0:18673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684374.637875:0:18673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788684374.637877:0:18673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684374.637879:0:18673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788684374.637880:0:18673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684374.637881:0:18673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684374.637883:0:18673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684374.637884:0:18673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684374.637885:0:18673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684374.637886:0:18673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684374.637887:0:18673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684374.637923:0:18673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788684374.637943:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085853056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788684374.638007:0:18673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684374.638040:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684374.638421:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085853056 00000100:00100000:2.0:1788684374.638428:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085853056 00000100:00100000:2.0:1788684374.638480:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788684374.638490:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085853056:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788684374.638517:0:17165:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788684374.638531:0:17165:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788684374.648960:0:17165:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788684374.648979:0:17165:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788684374.649291:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:18673:x1875571085853056:12345-0@lo:253:mount.lustre.0 Request processed in 10798us (11278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684374.649305:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788684374.649429:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:18673:1875571085853056:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788684374.649444:0:18673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788684374.649447:0:18673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788684374.649450:0:18673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788684374.649451:0:18673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684374.649452:0:18673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684374.649453:0:18673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684374.649472:0:18673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684374.649473:0:18673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788684374.649475:0:18673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684374.649476:0:18673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788684374.649490:0:18673:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788684374.650951:0:17187:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788684374.650959:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788684374.650993:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.651009:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad60e expref: 20 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.651016:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad61c expref: 20 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.651023:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.651565:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad61c expref: 20 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.651581:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad61c expref: 20 pid: 17164 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684374.651594:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085853184:0@lo:104: 00000100:00100000:1.0:1788684374.651648:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684374.651702:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad60e expref: 20 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.651710:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad60e expref: 20 pid: 17165 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684374.651718:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085853312:0@lo:104: 00000100:00100000:1.0:1788684374.651741:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684374.651849:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742f85840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684374.651935:0:17155:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788684374.651957:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085853184 00000100:00100000:2.0:1788684374.651964:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085853184 00000100:00100000:2.0:1788684374.651995:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085853312 00000100:00100000:2.0:1788684374.651998:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085853312 00000100:00100000:2.0:1788684374.652010:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684374.652017:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+4:17187:x1875571085853184:12345-0@lo:104: 00010000:00010000:2.0:1788684374.652030:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652162:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788684374.652168:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+4:17187:x1875571085853184:12345-0@lo:104: Request processed in 151us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684374.652176:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684374.652191:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684374.652198:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664853cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085853312:12345-0@lo:104: 00010000:00010000:2.0:1788684374.652205:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652240:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788684374.652245:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664853cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085853312:12345-0@lo:104: Request processed in 48us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684374.652250:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788684374.652283:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684374.652289:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652310:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684374.652314:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652322:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684374.652329:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684374.652334:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684374.652361:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652387:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684374.652404:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652410:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647890a00/0x44bac02bd54ad61c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad623 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652422:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684374.652425:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652430:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684374.652432:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652448:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684374.652456:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684374.652472:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684374.652486:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652492:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684374.652505:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652512:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d4e00/0x44bac02bd54ad60e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad615 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652523:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684374.652524:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684374.652526:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684374.652531:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684374.652541:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085853568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684374.652571:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684374.652610:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085853568 00000100:00100000:2.0:1788684374.652614:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085853568 00010000:00010000:2.0:1788684374.652628:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad60e expref: 21 pid: 17165 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684374.652648:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684374.652662:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+21:3623:x1875571085853568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684374.652672:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684374.652677:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad60e expref: 21 pid: 17165 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652686:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad60e expref: 21 pid: 17165 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684374.652699:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684374.652725:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+21:3623:x1875571085853568:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684374.652731:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684374.652760:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085853568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684374.653577:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa72d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085853184:0@lo:104: 00010000:00010000:1.0:1788684374.653589:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d5600/0x44bac02bd54ad615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad60e expref: 20 pid: 17165 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684374.653610:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085853312:0@lo:104: 00010000:00010000:1.0:1788684374.653628:0:17187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684374.654025:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085853440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684374.654088:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684374.655864:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085853440 00000100:00100000:1.0:1788684374.655876:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085853440 00010000:00010000:1.0:1788684374.655928:0:17156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad61c expref: 20 pid: 17164 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684374.655983:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788684374.655994:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67771e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c986901f-6089-4802-a23d-1179db951431+20:3626:x1875571085853440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684374.656008:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684374.656013:0:17156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad61c expref: 20 pid: 17164 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656024:0:17156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad61c expref: 20 pid: 17164 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656039:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad61c expref: 20 pid: 17164 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656062:0:17156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656070:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788684374.656086:0:17156:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005127180s 00010000:00010000:1.0:1788684374.656091:0:17156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656112:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656119:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656127:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656134:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684374.656139:0:17156:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656148:0:17156:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656168:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656179:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684374.656243:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67771e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c986901f-6089-4802-a23d-1179db951431+19:3626:x1875571085853440:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684374.656250:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788684374.656302:0:17187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656310:0:17187:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684374.656316:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b0400/0x44bac02bd54ad6cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684374.656752:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085853440:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788684374.662133:0:18673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788684374.666340:0:18673:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788684374.666350:0:18673:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788684374.666555:0:18673:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788684374.666597:0:18673:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788684374.666619:0:18673:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788684374.666645:0:18673:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788684374.671117:0:18673:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684374.671354:0:18673:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788684374.782936:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684375.807707:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788684375.813741:0:18752:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684375.813992:0:18752:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788684376.129657:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788684376.573458:0:17168:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788684376.573466:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d678003e800 from 9 10000000:01000000:2.0:1788684376.573472:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788684376.573513:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684376.573525:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684376.573543:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684376.573568:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085853696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684376.573629:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684376.573670:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d4d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788684376.573810:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085853696 00000100:00100000:3.0:1788684376.573818:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085853696 00000100:00100000:3.0:1788684376.573868:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788684376.573878:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+19:17168:x1875571085853696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684376.573902:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684376.573915:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad6d2 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684376.573948:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad6d2 expref: 20 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684376.573958:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad6d2 expref: 20 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684376.573967:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c800, rc 0) 00000100:00100000:3.0:1788684376.574008:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+20:17168:x1875571085853696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684376.574015:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788684376.574348:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085853696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684376.574362:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684376.574398:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684376.574448:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085853824:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788684376.574482:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684376.574500:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d4d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788684376.575239:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085853824 00000100:00100000:3.0:1788684376.575247:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085853824 00000100:00100000:3.0:1788684376.575281:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788684376.575288:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+20:17168:x1875571085853824:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788684376.575304:0:17165:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788684376.575320:0:17165:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788684376.575323:0:17165:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788684376.575536:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+20:17168:x1875571085853824:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 248us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684376.575544:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788684376.575615:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085853824:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788684376.575678:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684376.575687:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684376.575695:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684376.575703:0:17168:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684376.575706:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d66484cb800 from 9 10000000:01000000:0.0:1788684376.575708:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684376.575730:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684376.575737:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684376.575744:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684376.575772:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085853952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684376.575803:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684376.575835:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684376.575963:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085853952 00000100:00100000:2.0:1788684376.575968:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085853952 00000100:00100000:2.0:1788684376.576002:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788684376.576009:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+20:17168:x1875571085853952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684376.576016:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684376.576027:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad6e0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684376.576044:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad6e0 expref: 21 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684376.576065:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad6e0 expref: 21 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684376.576072:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5400, rc 0) 00000100:00100000:2.0:1788684376.576103:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+21:17168:x1875571085853952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684376.576218:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788684376.576249:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085853952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684376.576261:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684376.576269:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684376.576309:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085854080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788684376.576454:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684376.578156:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d4da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684376.583822:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085854080 00000100:00100000:3.0:1788684376.583834:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085854080 00000100:00100000:3.0:1788684376.583897:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788684376.583907:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:17168:x1875571085854080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788684376.583932:0:17163:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788684376.583953:0:17163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788684376.583956:0:17163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788684376.584096:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:17168:x1875571085854080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (7641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684376.584104:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788684376.584474:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085854080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788684376.584539:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788684376.584549:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684376.584560:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684376.829941:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684377.854265:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684378.751932:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085854208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684378.752004:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684378.752059:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085854208 00000100:00100000:1.0:1788684378.752066:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085854208 00000100:00100000:1.0:1788684378.752826:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788684378.752839:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085854208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684378.752873:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788684378.752943:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085854208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684378.752950:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788684378.753008:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085854208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684378.756261:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085854336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684378.756345:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684378.756453:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085854336 00000100:00100000:3.0:1788684378.756459:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085854336 00000100:00100000:3.0:1788684378.756502:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788684378.756510:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085854336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684378.756546:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788684378.756608:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085854336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684378.756614:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788684378.756652:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085854336:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788684378.884224:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788684379.774899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684379.774906:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684379.774909:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684379.774912:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684379.774927:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684379.774930:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684379.774933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684379.774936:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788684379.774969:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085854464:0@lo:400:kworker.0 00000100:00100000:0.0:1788684379.775325:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684379.775389:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085854976:0@lo:400:kworker.0 00000100:00100000:0.0:1788684379.775419:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684379.775440:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684379.775445:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085854848:0@lo:400:kworker.0 00000100:00100000:0.0:1788684379.775468:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684379.775499:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085854464 00000100:00100000:0.0:1788684379.775506:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085854464 00000100:00100000:0.0:1788684379.775548:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788684379.775556:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:3626:x1875571085854464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684379.775601:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:3626:x1875571085854464:12345-0@lo:400:kworker.0 Request processed in 45us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684379.775608:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788684379.775643:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085854976 00000100:00100000:0.0:1788684379.775656:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085854976 00000100:00100000:0.0:1788684379.775682:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684379.775689:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085854976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684379.775721:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085854976:12345-0@lo:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684379.775728:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684379.775954:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085854464:0@lo:400:kworker.0 00010000:00080000:0.0:1788684379.775968:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648664700 x1875571085854976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684379.775980:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085854976:0@lo:400:kworker.0 00000100:00100000:1.0:1788684379.776903:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085854592:0@lo:400:kworker.0 00000100:00100000:1.0:1788684379.776952:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684379.776978:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085855104:0@lo:400:kworker.0 00000100:00100000:1.0:1788684379.777004:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684379.777026:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788684379.777134:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085854848 00000100:00100000:3.0:1788684379.777139:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085854848 00000100:00100000:3.0:1788684379.777172:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085854592 00000100:00100000:3.0:1788684379.777175:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085854592 00000100:00100000:3.0:1788684379.777188:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788684379.777202:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085854848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684379.777253:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085854848:12345-0@lo:400:kworker.0 Request processed in 51us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684379.777260:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788684379.777274:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788684379.777280:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085854592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684379.777306:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085854592:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684379.777312:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788684379.777346:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085854848:0@lo:400:kworker.0 00000100:00100000:1.0:1788684379.777842:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085854720:0@lo:400:kworker.0 00000100:00100000:1.0:1788684379.777887:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684379.777915:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085855232:0@lo:400:kworker.0 00000100:00100000:1.0:1788684379.777940:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684379.777967:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085854592:0@lo:400:kworker.0 00000100:00100000:1.0:1788684379.778010:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085855104 00000100:00100000:1.0:1788684379.778022:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085855104 00000100:00100000:0.0:1788684379.778839:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085854720 00000100:00100000:0.0:1788684379.778846:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085854720 00000100:00100000:0.0:1788684379.778886:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085855232 00000100:00100000:0.0:1788684379.778889:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085855232 00000100:00100000:0.0:1788684379.778907:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684379.778914:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085854720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684379.778975:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085854720:12345-0@lo:400:kworker.0 Request processed in 60us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684379.778983:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684379.778997:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684379.779003:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085855232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684379.779133:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788684379.779141:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085855104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684379.779174:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085855104:12345-0@lo:400:kworker.0 Request processed in 35us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684379.779181:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788684379.779216:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648666680 x1875571085854720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684379.779230:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085854720:0@lo:400:kworker.0 00010000:00080000:1.0:1788684379.779241:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6747a6ce00 x1875571085855232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684379.779250:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085855232:0@lo:400:kworker.0 00010000:00080000:1.0:1788684379.779261:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6747a6ed80 x1875571085855104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684379.779270:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085855104:0@lo:400:kworker.0 00000100:00080000:2.0:1788684379.782486:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684379.782494:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684379.785580:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085855232:12345-0@lo:400:kworker.0 Request processed in 28us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684379.785594:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788684379.901617:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788684380.670447:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788684380.860938:0:19042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788684380.933752:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788684381.692809:0:19094:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788684381.693013:0:19094:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788684381.949675:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788684382.540928:0:19144:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788684382.541121:0:19144:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788684382.974756:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684383.869532:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684383.869552:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085855360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684383.869620:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684383.869690:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085855360 00000100:00100000:1.0:1788684383.869711:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085855360 00000100:00100000:1.0:1788684383.869758:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684383.869765:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085855360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684383.869795:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788684383.869835:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085855360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684383.869841:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684383.869903:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085855360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684383.871215:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684368/real 1788684368] req@ffff8d664876e300 x1875571085848320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684383 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684383.871239:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d664876e300 x1875571085848320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684383 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684383.871249:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684368/real 1788684368] req@ffff8d664876c000 x1875571085848448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684383 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684383.871259:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d664876c000 x1875571085848448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684383 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788684383.871275:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664773f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684383.871294:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788684383.871298:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085848320:0@lo:8:kworker.0 00000100:00080000:3.0:1788684383.871303:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684383.871308:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788684383.871323:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085848448:0@lo:8:kworker.0 00000100:00080000:2.0:1788684383.871424:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684383.871428:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684383.871431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684383.871434:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684383.871461:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684383.871464:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788684383.871466:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d664773f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684383.871470:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 449 00000100:00080000:2.0:1788684383.871475:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788684383.871480:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d664773f000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684383.871497:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876e300 x1875571085855872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684383.871511:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684383.871514:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788684383.871515:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684383.871518:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 449 00000100:00080000:2.0:1788684383.871520:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788684383.871523:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d6775fa6000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684383.871532:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876f480 x1875571085856000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684383.871567:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085855872:0@lo:8:kworker.0 00000100:00100000:2.0:1788684383.871618:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684383.871650:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085856000:0@lo:8:kworker.0 00000100:00100000:2.0:1788684383.871673:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684383.871705:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085855872 00000100:00100000:2.0:1788684383.871709:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085855872 00000100:00100000:2.0:1788684383.871728:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085856000 00000100:00100000:2.0:1788684383.871730:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085856000 00000100:00100000:2.0:1788684383.871740:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684383.871746:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1875571085855872:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788684383.871774:0:18677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1788684383.871799:0:18677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ad6ee 00002000:00100000:2.0:1788684383.871812:0:18677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d664740e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788684383.871815:0:18677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788684383.871818:0:18677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788684383.871985:0:18677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788684383.872009:0:18677:0:(import.c:65:import_set_state_nolock()) ffff8d664740c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684383.872050:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1875571085855872:12345-0@lo:8:kworker.0 Request processed in 303us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684383.872057:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684383.872173:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085856128:0@lo:400:kworker.0 00000100:00100000:0.0:1788684383.872203:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684383.872221:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788684383.872227:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085855488:0@lo:400:kworker.0 00000100:00100000:0.0:1788684383.872252:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684383.872264:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085856256:0@lo:400:kworker.0 00000100:00100000:0.0:1788684383.872282:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684383.872358:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684383.872394:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1875571085856000:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788684383.872407:0:18679:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788684383.873215:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085855616:0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.873251:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684383.873269:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085856384:0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.873284:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684383.873304:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788684383.873309:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085855744:0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.873329:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684383.873342:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085856512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684383.873356:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684383.873398:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085856128 00000100:00100000:1.0:1788684383.873409:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085856128 00000100:00100000:1.0:1788684383.873436:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085856256 00000100:00100000:1.0:1788684383.873438:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085856256 00000100:00100000:1.0:1788684383.873456:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085855616 00000100:00100000:1.0:1788684383.873458:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085855616 00000100:00100000:1.0:1788684383.873466:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085856384 00000100:00100000:1.0:1788684383.873468:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085856384 00000100:00100000:1.0:1788684383.873482:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684383.873488:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085856128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.873538:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085856128:12345-0@lo:400:kworker.0 Request processed in 50us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684383.873545:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684383.873558:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684383.873563:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085856256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.873584:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085856256:12345-0@lo:400:kworker.0 Request processed in 22us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684383.873589:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684383.873598:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684383.873603:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085855616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.873624:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085855616:12345-0@lo:400:kworker.0 Request processed in 21us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684383.873630:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684383.873638:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788684383.873643:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085856384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.873662:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085856384:12345-0@lo:400:kworker.0 Request processed in 19us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684383.873667:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788684383.873681:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085855488 00000100:00100000:1.0:1788684383.873684:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085855488 00000100:00100000:1.0:1788684383.873702:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788684383.873707:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+21:3625:x1875571085855488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.873729:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+21:3625:x1875571085855488:12345-0@lo:400:kworker.0 Request processed in 23us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684383.873735:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788684383.873774:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085855744 00000100:00100000:1.0:1788684383.873777:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085855744 00000100:00100000:1.0:1788684383.873793:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085856512 00000100:00100000:1.0:1788684383.873795:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085856512 00000100:00100000:1.0:1788684383.873803:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788684383.873808:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1875571085855744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.873834:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1875571085855744:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684383.873840:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788684383.873860:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788684383.873866:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085856512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684383.873886:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788684383.873911:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085856512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684383.873916:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788684383.873930:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684383.873934:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684383.873962:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085855488:0@lo:400:kworker.0 00010000:00080000:1.0:1788684383.873975:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876e680 x1875571085856256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684383.873986:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085856256:0@lo:400:kworker.0 00010000:00080000:1.0:1788684383.873995:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876fb80 x1875571085856128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684383.874003:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085856128:0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.874028:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085855744:0@lo:400:kworker.0 00000100:00100000:1.0:1788684383.874048:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085856512:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1788684383.874183:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876e300 x1875571085855872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684383.874192:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684383.874198:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788684383.874205:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788684383.874210:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788684383.874213:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664773f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788684383.874224:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788684383.874228:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085855872:0@lo:8:kworker.0 00000004:00080000:0.0:1788684383.874417:0:17913:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788684383.874434:0:17913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17913:1875571085856768:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788684383.874461:0:17913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684383.874475:0:17913:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777145b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788684383.874826:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085856640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684383.874862:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684383.874906:0:18677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788684383.874913:0:18677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788684383.874994:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085856768 00000100:00100000:2.0:1788684383.874998:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085856768 00000100:00100000:0.0:1788684383.875162:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085856640 00000100:00100000:0.0:1788684383.875166:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085856640 00000100:00100000:0.0:1788684383.875191:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684383.875197:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1875571085856640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684383.875219:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788684383.875252:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1875571085856640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684383.875258:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788684383.875284:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6747a6d500 x1875571085856640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684383.875297:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085856640:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788684383.876192:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876ce00 x1875571085855616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684383.876204:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085855616:0@lo:400:kworker.0 00010000:00080000:1.0:1788684383.876217:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876d180 x1875571085856384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684383.876225:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085856384:0@lo:400:kworker.0 00000004:00080000:1.0:1788684383.876257:0:17911:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788684383.876356:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684383.876394:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17913:x1875571085856768:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1788684383.876631:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788684383.877049:0:17911:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 464870681809ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788684383.877056:0:17911:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:0.0:1788684383.882223:0:19204:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788684383.882232:0:19204:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788684383.883212:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17913:x1875571085856768:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6814us (8743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684383.883243:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:2.0:1788684383.885239:0:17903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:1.0:1788684383.886205:0:17913:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6747a6c700 x1875571085856768/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788684399 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684383.886222:0:17913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17913:1875571085856768:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788684383.886236:0:17913:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788684383.886275:0:17913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17913:1875571085856896:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788684383.886329:0:17913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684383.886437:0:17913:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742ffda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684383.888483:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085856896 00000100:00100000:2.0:1788684383.888496:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085856896 00000100:00100000:2.0:1788684383.888598:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684383.888608:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17913:x1875571085856896:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788684383.888637:0:18677:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788684383.888711:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17913:x1875571085856896:12345-0@lo:5:osp-pre-0-1.0 Request processed in 104us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684383.888718:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788684383.888786:0:17913:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6647a61f80 x1875571085856896/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684399 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684383.888800:0:17913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17913:1875571085856896:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788684383.888811:0:17913:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788684383.888859:0:17913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17913:1875571085857024:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788684383.888903:0:17913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684383.890413:0:17913:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742ffda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684383.890612:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085857024 00000100:00100000:0.0:1788684383.890620:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085857024 00000100:00100000:0.0:1788684383.890661:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684383.890669:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17913:x1875571085857024:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788684383.890704:0:19204:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788684383.891764:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1875571085856000:12345-0@lo:8:kworker.0 Request processed in 19395us (20086us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788684383.891775:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788684383.891796:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684383.891801:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788684383.891805:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085856000:0@lo:8:kworker.0 00000001:00080000:2.0:1788684383.920939:0:18674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788684383.920954:0:18674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788684383.921279:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17913:x1875571085857024:12345-0@lo:5:osp-pre-0-1.0 Request processed in 30607us (32372us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788684383.921290:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788684383.921358:0:17913:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6647a61f80 x1875571085857024/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684399 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684383.921555:0:17913:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788684383.921562:0:17913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17913:1875571085857024:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788684383.921577:0:17913:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1788684383.921624:0:17913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17913:1875571085857152:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788684383.921657:0:17913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684383.921686:0:17913:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742ffda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684383.921762:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085857152 00000100:00100000:3.0:1788684383.921769:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085857152 00000100:00100000:3.0:1788684383.921919:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684383.921928:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17913:x1875571085857152:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788684383.921982:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17913:x1875571085857152:12345-0@lo:900:osp-pre-0-1.0 Request processed in 55us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684383.921988:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788684383.922044:0:17913:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6647a61f80 x1875571085857152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788684399 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684383.922056:0:17913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17913:1875571085857152:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788684383.998209:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684385.022597:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684386.045694:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788684386.366161:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788684387.069959:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684388.099557:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684388.990477:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684388.990505:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085857280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684388.990601:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684388.990685:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085857280 00000100:00100000:1.0:1788684388.990695:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085857280 00000100:00100000:1.0:1788684388.990754:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788684388.990765:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085857280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684388.990813:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788684388.990878:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085857280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684388.990886:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788684388.990945:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085857280:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788684388.991720:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684388.991725:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684388.991728:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684388.991740:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684388.991778:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684388.991782:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788684388.991786:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684388.991793:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1788684388.991798:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788684388.991804:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d6775fa6000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684388.991837:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648602300 x1875571085857920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684388.991990:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085857408:0@lo:400:kworker.0 00000100:00100000:1.0:1788684388.992057:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684388.992079:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085857920:0@lo:8:kworker.0 00000100:00100000:1.0:1788684388.992095:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085858048:0@lo:400:kworker.0 00000100:00100000:3.0:1788684388.992138:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684388.992139:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684388.992178:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788684388.992186:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085857536:0@lo:400:kworker.0 00000100:00100000:3.0:1788684388.992193:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085857920 00000100:00100000:3.0:1788684388.992201:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085857920 00000100:00100000:1.0:1788684388.992214:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684388.992232:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085858176:0@lo:400:kworker.0 00000100:00100000:3.0:1788684388.992240:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684388.992249:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1875571085857920:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788684388.992257:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684388.992285:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085857792:0@lo:400:kworker.0 00000100:00100000:1.0:1788684388.992309:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684388.992325:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788684388.992330:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085857664:0@lo:400:kworker.0 00010000:00020000:3.0:1788684388.992345:0:18679:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788684388.992352:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684388.992663:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085858304:0@lo:400:kworker.0 00000100:00100000:1.0:1788684388.992693:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684388.992721:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085858048 00000100:00100000:1.0:1788684388.992726:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085858048 00000100:00100000:1.0:1788684388.992753:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085858176 00000100:00100000:1.0:1788684388.992755:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085858176 00000100:00100000:1.0:1788684388.992776:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085857664 00000100:00100000:1.0:1788684388.992778:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085857664 00000100:00100000:1.0:1788684388.992789:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085858304 00000100:00100000:1.0:1788684388.992791:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085858304 00000100:00100000:1.0:1788684388.992804:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788684388.992809:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085858048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684388.992870:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085858048:12345-0@lo:400:kworker.0 Request processed in 60us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684388.992877:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788684388.992895:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788684388.992900:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085858176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684388.992923:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085858176:12345-0@lo:400:kworker.0 Request processed in 23us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684388.992929:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788684388.992938:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788684388.992943:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085857664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684388.992968:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085857664:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684388.992974:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788684388.992984:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788684388.992990:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085858304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684388.993015:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085858304:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684388.993027:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788684388.993074:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6647a60e00 x1875571085857664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684388.993087:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085857664:0@lo:400:kworker.0 00010000:00080000:1.0:1788684388.993101:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648600e00 x1875571085858304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684388.993107:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085858304:0@lo:400:kworker.0 00010000:00080000:1.0:1788684388.993141:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648603b80 x1875571085858176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684388.993149:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085858176:0@lo:400:kworker.0 00010000:00080000:1.0:1788684388.993159:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648603100 x1875571085858048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684388.993167:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085858048:0@lo:400:kworker.0 00000100:00100000:2.0:1788684388.994743:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085857792 00000100:00100000:2.0:1788684388.994861:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085857792 00000100:00100000:2.0:1788684388.994937:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684388.994949:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085857792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684388.995061:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085857792:12345-0@lo:400:kworker.0 Request processed in 115us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684388.995069:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788684388.995125:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6647a62a00 x1875571085857792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684388.995143:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085857792:0@lo:400:kworker.0 00000100:00100000:0.0:1788684388.996228:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085857408 00000100:00100000:0.0:1788684388.996236:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085857408 00000100:00100000:0.0:1788684388.996284:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788684388.996294:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:3623:x1875571085857408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684388.996397:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:3623:x1875571085857408:12345-0@lo:400:kworker.0 Request processed in 105us (4341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684388.996405:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788684388.996449:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085857536 00000100:00100000:0.0:1788684388.996462:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085857536 00000100:00100000:0.0:1788684388.996490:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684388.996496:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085857536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684388.996531:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085857536:12345-0@lo:400:kworker.0 Request processed in 35us (4317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684388.996537:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788684388.996559:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684388.996565:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684388.996568:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684388.996582:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684388.996596:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085858432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684388.996631:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684388.996685:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085857536:0@lo:400:kworker.0 00000100:00100000:0.0:1788684388.996710:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085857408:0@lo:400:kworker.0 00000100:00100000:0.0:1788684388.996736:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085858432 00000100:00100000:0.0:1788684388.996739:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085858432 00000100:00100000:0.0:1788684388.996770:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684388.996776:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085858432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788684388.996807:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788684388.996859:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085858432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684388.996866:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684388.996898:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085858432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684388.997172:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684388.997189:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085858560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684388.997225:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684388.997285:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085858560 00000100:00100000:0.0:1788684388.997289:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085858560 00000100:00100000:0.0:1788684388.997327:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788684388.997334:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085858560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684388.997361:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788684388.997421:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085858560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684388.997428:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788684388.997459:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876df80 x1875571085858560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684388.997473:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085858560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684389.021994:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1875571085857920:12345-0@lo:8:kworker.0 Request processed in 29732us (29846us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788684389.022013:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788684389.022938:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684389.022951:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788684389.022956:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085857920:0@lo:8:kworker.0 00010000:00010000:2.0:1788684389.120880:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788684389.546888:0:19490:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788684389.546891:0:19490:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788684389.546893:0:19490:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788684389.547436:0:19490:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d6646ccf000 00000020:01000004:3.0:1788684389.547453:0:19490:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788684389.547467:0:19490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788684389.547481:0:19490:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d6746c03380) 00000020:00000080:3.0:1788684389.547498:0:19490:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788684389.604179:0:19490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788684389.604746:0:19490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788684389.605284:0:19490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788684389.605557:0:19490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788684389.605782:0:19490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788684389.605994:0:19490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788684389.609476:0:19490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788684389.612864:0:19490:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788684389.613726:0:19490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788684389.613740:0:19490:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788684389.613752:0:19490:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x44bac02bd54ad6fc 00000020:01000004:3.0:1788684389.613759:0:19490:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788684389.613780:0:19490:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788684389.613783:0:19490:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788684389.613788:0:19490:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788684389.613817:0:19490:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788684389.613832:0:19490:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788684389.622973:0:19490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788684389.623083:0:19490:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788684389.623088:0:19490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788684389.623090:0:19490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788684389.623091:0:19490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684389.623092:0:19490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684389.623093:0:19490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684389.623094:0:19490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684389.623096:0:19490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684389.623097:0:19490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684389.623099:0:19490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684389.623103:0:19490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788684389.623105:0:19490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684389.623112:0:19490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788684389.623113:0:19490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684389.623114:0:19490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684389.623116:0:19490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684389.623117:0:19490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684389.623118:0:19490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684389.623119:0:19490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684389.623120:0:19490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684389.623148:0:19490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788684389.623167:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085858688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788684389.623236:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.623336:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684389.623467:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085858688 00000100:00100000:0.0:1788684389.623475:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085858688 00000100:00100000:0.0:1788684389.623519:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788684389.623529:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:19490:x1875571085858688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788684389.623683:0:17165:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788684389.623758:0:17165:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788684389.623763:0:17165:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788684389.624229:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:19490:x1875571085858688:12345-0@lo:253:mount.lustre.0 Request processed in 697us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684389.624240:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684389.624317:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085858688:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788684389.624328:0:19490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788684389.624331:0:19490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788684389.624332:0:19490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788684389.624333:0:19490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684389.624334:0:19490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684389.624335:0:19490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684389.624337:0:19490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684389.624338:0:19490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684389.624339:0:19490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684389.624340:0:19490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788684389.624360:0:19490:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d6646ccf000 from lustre-OST0001 10000000:01000000:1.0:1788684389.624608:0:19490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788684389.624612:0:19490:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788684389.624620:0:19490:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d677e3eb380 local copy 00010000:00010000:1.0:1788684389.624631:0:19490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684389.624723:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085858816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684389.624756:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.624831:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684389.624912:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085858816 00000100:00100000:0.0:1788684389.624918:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085858816 00000100:00100000:0.0:1788684389.624951:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788684389.624958:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+21:19490:x1875571085858816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684389.625156:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+21:19490:x1875571085858816:12345-0@lo:501:mount.lustre.0 Request processed in 197us (399us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788684389.625174:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788684389.625228:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085858816:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788684389.625247:0:19490:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788684389.625261:0:19490:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788684389.625267:0:19490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.625276:0:19490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684389.625298:0:19490:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d6646ccf000 10000000:01000000:1.0:1788684389.625302:0:19490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788684389.625307:0:19490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788684389.625309:0:19490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788684389.625313:0:19490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788684389.625315:0:19490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788684389.625335:0:19490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.625343:0:19490:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.625352:0:19490:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684389.625430:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085858944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788684389.625455:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.625507:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684389.625534:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085858944 00000100:00100000:0.0:1788684389.625591:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085858944 00000100:00100000:0.0:1788684389.625651:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788684389.625658:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:19490:x1875571085858944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684389.625667:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684389.625678:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad70a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad703 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684389.625706:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad703 expref: 22 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684389.625716:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad703 expref: 22 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684389.625724:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891c00, rc 0) 00000100:00100000:0.0:1788684389.625754:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085858944:12345-0@lo:101:mount.lustre.0 Request processed in 97us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684389.625760:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788684389.625806:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085858944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684389.625817:0:19490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.625841:0:19490:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788684389.626781:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788684389.627339:0:19490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684389.629697:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788684389.629754:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788684389.629770:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788684389.629785:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788684389.629798:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788684389.629810:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788684389.629846:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788684389.629851:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788684389.629969:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684389.630046:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.630096:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684389.630165:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085859072 00000100:00100000:2.0:1788684389.630173:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085859072 00000100:00100000:2.0:1788684389.630227:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788684389.630236:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085859072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684389.630408:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085859072:12345-0@lo:501:mount.lustre.0 Request processed in 172us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684389.630415:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788684389.630740:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684389.630772:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684389.630813:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.630851:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684389.630897:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085859200 00000100:00100000:2.0:1788684389.630902:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085859200 00000100:00100000:2.0:1788684389.630934:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788684389.630941:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085859200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788684389.631870:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085859200:12345-0@lo:503:mount.lustre.0 Request processed in 926us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684389.631880:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788684389.631978:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788684389.632525:0:19490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788684389.632597:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684389.632645:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.632693:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684389.632748:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085859328 00000100:00100000:3.0:1788684389.632755:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085859328 00000100:00100000:3.0:1788684389.632791:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788684389.632799:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085859328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684389.633272:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085859328:12345-0@lo:502:mount.lustre.0 Request processed in 472us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.633287:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788684389.634862:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684389.635145:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788684389.635177:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788684389.635192:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788684389.635204:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788684389.635218:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788684389.635230:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788684389.635243:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788684389.635257:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788684389.635271:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788684389.635309:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684389.635408:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.635450:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684389.635601:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085859456 00000100:00100000:3.0:1788684389.635608:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085859456 00000100:00100000:3.0:1788684389.635651:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788684389.635659:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085859456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684389.635785:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085859456:12345-0@lo:502:mount.lustre.0 Request processed in 126us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.635792:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788684389.636771:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684389.636865:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788684389.636876:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788684389.638910:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788684389.638924:0:19494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788684389.638931:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684389.638933:0:19494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788684389.638940:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684389.638963:0:19494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d6645b1b380) 00000020:00000080:3.0:1788684389.638988:0:19494:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788684389.638995:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788684389.639096:0:19494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6646ccf000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788684389.639105:0:19494:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788684389.639112:0:19494:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x44bac02bd54ad718 00010000:00010000:3.0:1788684389.643079:0:19494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788684389.643600:0:19494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1788684389.645333:0:19494:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788684389.648346:0:19494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788684389.648358:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684389.648396:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684389.648398:0:19494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788684389.648403:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684389.648407:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684389.648408:0:19494:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684389.648418:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684389.648420:0:19494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788684389.648422:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684389.648425:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684389.648426:0:19494:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788684389.648428:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684389.648431:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684389.648432:0:19494:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788684389.648436:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788684389.648465:0:19494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684389.648468:0:19494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684389.648469:0:19494:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788684389.648473:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788684389.648737:0:19490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788684389.648773:0:19490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788684389.648798:0:19490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.648810:0:19490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684389.648829:0:19490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6646ccf000 from 1 10000000:01000000:2.0:1788684389.648833:0:19490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684389.648871:0:19490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.648890:0:19490:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.648902:0:19490:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684389.648926:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788684389.648990:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.649244:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67433c3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788684389.655617:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085859584 00000100:00100000:3.0:1788684389.655634:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085859584 00000100:00100000:3.0:1788684389.655801:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788684389.655813:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:19490:x1875571085859584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684389.655844:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684389.655865:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad71f expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.655894:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad71f expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.655905:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad71f expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.655915:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711c200, rc 0) 00000100:00100000:3.0:1788684389.655993:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085859584:12345-0@lo:101:mount.lustre.0 Request processed in 184us (7004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.656142:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788684389.656243:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684389.656262:0:19490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.656272:0:19490:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788684389.659125:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788684389.659437:0:19490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684389.659675:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788684389.659717:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788684389.659736:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788684389.659742:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788684389.659816:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684389.659902:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.660009:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67433c3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684389.669214:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085859712 00000100:00100000:0.0:1788684389.669225:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085859712 00000100:00100000:3.0:1788684389.669484:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788684389.669496:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085859712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684389.669675:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085859712:12345-0@lo:501:mount.lustre.0 Request processed in 181us (9772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.669812:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788684389.671848:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684389.671907:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684389.671972:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.672010:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684389.672057:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085859840 00000100:00100000:3.0:1788684389.672064:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085859840 00000100:00100000:3.0:1788684389.672114:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788684389.672122:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085859840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684389.672234:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085859840:12345-0@lo:503:mount.lustre.0 Request processed in 111us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.672241:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788684389.672290:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859840:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788684389.672900:0:19490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788684389.672967:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684389.673010:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684389.673037:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742ffd840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684389.673133:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085859968 00000100:00100000:1.0:1788684389.673143:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085859968 00000100:00100000:1.0:1788684389.673177:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788684389.673185:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085859968:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684389.673283:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085859968:12345-0@lo:502:mount.lustre.0 Request processed in 99us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684389.673290:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788684389.673415:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085859968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788684389.673837:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788684389.673865:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788684389.673880:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788684389.673896:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788684389.673910:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788684389.673926:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788684389.673940:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788684389.673954:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788684389.673983:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788684389.674008:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788684389.674023:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788684389.674049:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684389.674092:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.674113:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67433c3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788684389.674250:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085860096 00000100:00100000:3.0:1788684389.674256:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085860096 00000100:00100000:3.0:1788684389.674286:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788684389.674293:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085860096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684389.674414:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085860096:12345-0@lo:502:mount.lustre.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.674420:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788684389.674964:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788684389.675019:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788684389.675029:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788684389.676042:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684389.676053:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684389.676056:0:19498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788684389.676063:0:19498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6646ccf000 00000020:00000080:1.0:1788684389.676065:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788684389.676073:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684389.676076:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684389.676077:0:19498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788684389.676080:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684389.676083:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684389.676084:0:19498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788684389.676087:0:19498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6646ccf000 00000020:00000080:1.0:1788684389.676089:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788684389.676181:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684389.676185:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684389.676187:0:19498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788684389.676189:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684389.676192:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684389.676193:0:19498:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788684389.676196:0:19498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6646ccf000 00000020:00000080:1.0:1788684389.676198:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788684389.678773:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684389.678786:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684389.678788:0:19498:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788684389.678792:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684389.678797:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684389.678805:0:19498:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788684389.678811:0:19498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6646ccf000 00000020:00000080:1.0:1788684389.678814:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788684389.679126:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684389.679131:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684389.679133:0:19498:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788684389.679137:0:19498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788684389.681764:0:19490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788684389.681834:0:19490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684389.681860:0:19490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684389.681873:0:19490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684389.681940:0:19490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788684389.681943:0:19490:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d6646ccf000 10000000:01000000:0.0:1788684389.681946:0:19490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d6646ccf000 10000000:01000000:0.0:1788684389.681950:0:19490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684389.681956:0:19490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6646ccf000 from 1 10000000:01000000:0.0:1788684389.681959:0:19490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788684389.681993:0:19490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684389.682001:0:19490:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684389.682012:0:19490:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684389.682043:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684389.682116:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684389.682152:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800afc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788684389.684075:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085860224 00000100:00100000:3.0:1788684389.684087:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085860224 00000100:00100000:3.0:1788684389.684146:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788684389.684155:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+23:19490:x1875571085860224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684389.684171:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684389.684187:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d677711d000/0x44bac02bd54ad734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad72d expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.684214:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d677711d000/0x44bac02bd54ad734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad72d expref: 24 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.684226:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d677711d000/0x44bac02bd54ad734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad72d expref: 24 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.684236:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d677711d000, rc 0) 00000100:00100000:3.0:1788684389.684473:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860224:12345-0@lo:101:mount.lustre.0 Request processed in 318us (2356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.684481:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788684389.684843:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684389.684863:0:19490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684389.684873:0:19490:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684389.687049:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1788684389.687329:0:19490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684389.689383:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788684389.689427:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788684389.689442:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788684389.689469:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788684389.689481:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788684389.689491:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788684389.689502:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788684389.689512:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788684389.689523:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788684389.689533:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788684389.689545:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788684389.689558:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788684389.689570:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788684389.689584:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788684389.689596:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788684389.689607:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788684389.689618:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788684389.689632:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788684389.689645:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788684389.689672:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788684389.689702:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788684389.689717:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788684389.689729:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788684389.689741:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788684389.689754:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788684389.689767:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788684389.689779:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788684389.689792:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788684389.689805:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788684389.689816:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788684389.689842:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788684389.689854:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788684389.689863:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788684389.689874:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788684389.689897:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788684389.689921:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788684389.689934:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788684389.689944:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788684389.689957:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1788684389.689970:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1788684389.689981:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1788684389.689992:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1788684389.690005:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1788684389.690018:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1788684389.690031:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1788684389.690045:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1788684389.690065:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1788684389.690070:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1788684389.690182:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684389.690246:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684389.690288:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800af300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684389.690315:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085860352 00000100:00100000:0.0:1788684389.690321:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085860352 00000100:00100000:0.0:1788684389.690392:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788684389.690402:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684389.690524:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860352:12345-0@lo:501:mount.lustre.0 Request processed in 123us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684389.690531:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788684389.690572:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684389.690601:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684389.690636:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684389.690654:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800af300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684389.690671:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085860480 00000100:00100000:0.0:1788684389.690674:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085860480 00000100:00100000:0.0:1788684389.690695:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788684389.690700:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684389.690765:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860480:12345-0@lo:503:mount.lustre.0 Request processed in 64us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684389.690771:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788684389.690806:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860480:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788684389.692811:0:19490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788684389.692916:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860608:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684389.692993:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684389.693084:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800afc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684389.696045:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085860608 00000100:00100000:1.0:1788684389.696058:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085860608 00000100:00100000:1.0:1788684389.696117:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788684389.696128:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860608:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684389.696286:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860608:12345-0@lo:502:mount.lustre.0 Request processed in 159us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684389.696294:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788684389.696421:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684389.696922:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788684389.696957:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788684389.696986:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788684389.697001:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788684389.697014:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788684389.697027:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788684389.697039:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788684389.697053:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788684389.697066:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788684389.697079:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788684389.697091:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788684389.697104:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788684389.697115:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788684389.697127:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788684389.697140:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788684389.697167:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788684389.697182:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788684389.697196:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788684389.697219:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788684389.697231:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788684389.697241:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788684389.697251:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788684389.697263:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788684389.697276:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788684389.697288:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788684389.697299:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788684389.697315:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788684389.697332:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788684389.697349:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788684389.697392:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788684389.697409:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788684389.697420:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788684389.697431:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788684389.697443:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788684389.697473:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788684389.697499:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788684389.697523:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788684389.697757:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788684389.697779:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788684389.697798:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788684389.697857:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788684389.697875:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788684389.697893:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788684389.697918:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788684389.697939:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788684389.697959:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788684389.697978:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788684389.697995:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788684389.698056:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684389.698121:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684389.698162:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800afc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684389.698303:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085860736 00000100:00100000:1.0:1788684389.698309:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085860736 00000100:00100000:1.0:1788684389.698351:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788684389.698359:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684389.698481:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860736:12345-0@lo:502:mount.lustre.0 Request processed in 122us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684389.698489:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788684389.698680:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684389.698962:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788684389.698999:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788684389.699026:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684389.699066:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684389.699135:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67800afc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684389.705953:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085860864 00000100:00100000:1.0:1788684389.705969:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085860864 00000100:00100000:1.0:1788684389.706067:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788684389.706080:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684389.706257:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085860864:12345-0@lo:502:mount.lustre.0 Request processed in 179us (7190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684389.706267:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788684389.709307:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085860864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684389.709426:0:19490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788684389.709440:0:19490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788684389.713523:0:19503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788684389.713541:0:19503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d677cf28000) 00000020:00000080:2.0:1788684389.713570:0:19503:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788684389.713667:0:19503:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6646ccf000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788684389.713672:0:19503:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6646ccf000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788684389.713675:0:19503:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6646ccf000 3 00010000:00080000:2.0:1788684389.713709:0:19503:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6646588800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684389.716751:0:19503:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788684389.717042:0:19503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788684389.717087:0:19503:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788684389.718522:0:19503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x44bac02bd54ad742 00000100:00080000:2.0:1788684389.718538:0:19503:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684389.718543:0:19503:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d6646588800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684389.718575:0:19503:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876c000 x1875571085860992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684389.718632:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085860992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788684389.718692:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684389.718746:0:19503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788684389.718859:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684389.718864:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684389.718867:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684389.718877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684389.718907:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684389.718910:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788684389.718912:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684389.718916:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1788684389.718919:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788684389.718922:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d6775fa6000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684389.718933:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876d180 x1875571085861632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684389.719021:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085861632:0@lo:8:kworker.0 00000100:00100000:1.0:1788684389.719058:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.719096:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085860992 00000100:00100000:1.0:1788684389.719104:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085860992 00000100:00100000:1.0:1788684389.719150:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788684389.719158:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085860992:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788684389.719185:0:17172:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:1.0:1788684389.719252:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x44bac02bd54ad749 00000004:00100000:1.0:1788684389.719272:0:17172:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788684389.719306:0:17172:0:(import.c:65:import_set_state_nolock()) ffff8d66459aa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684389.719356:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875571085860992:12345-0@lo:38:llog_process_th.0 Request processed in 197us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684389.719383:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788684389.719538:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876c000 x1875571085860992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684389.719548:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788684389.719556:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788684389.719562:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788684389.719567:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788684389.719569:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6646588800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788684389.719575:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085860992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788684389.719989:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085861120:0@lo:400:kworker.0 00000100:00100000:2.0:1788684389.720022:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.720042:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085861760:0@lo:400:kworker.0 00000100:00100000:2.0:1788684389.720063:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.720294:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684389.720305:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085861504:0@lo:400:kworker.0 00000100:00100000:2.0:1788684389.720331:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.720362:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085861248:0@lo:400:kworker.0 00000100:00100000:3.0:1788684389.720416:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085861760 00000100:00100000:3.0:1788684389.720423:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085861760 00000100:00100000:3.0:1788684389.720461:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684389.720469:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085861760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684389.720516:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085861760:12345-0@lo:400:kworker.0 Request processed in 48us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.720523:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788684389.720652:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085861120 00000100:00100000:0.0:1788684389.720657:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085861120 00000100:00100000:0.0:1788684389.720761:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684389.720772:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085861120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684389.720809:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085861120:12345-0@lo:400:kworker.0 Request processed in 40us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684389.720814:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684389.722990:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085861376:0@lo:400:kworker.0 00000100:00100000:0.0:1788684389.723066:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684389.723105:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085862016:0@lo:400:kworker.0 00000100:00100000:0.0:1788684389.723137:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684389.723184:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085861376 00000100:00100000:0.0:1788684389.723191:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085861376 00000100:00100000:0.0:1788684389.723237:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684389.723253:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085861376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684389.723313:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085861376:12345-0@lo:400:kworker.0 Request processed in 59us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684389.723321:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684389.723354:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085862016 00000100:00100000:0.0:1788684389.723357:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085862016 00000100:00100000:0.0:1788684389.723427:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788684389.723435:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085862016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684389.723469:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085862016:12345-0@lo:400:kworker.0 Request processed in 35us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684389.723476:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788684389.723514:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085861376:0@lo:400:kworker.0 00010000:00080000:0.0:1788684389.723529:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677fa70e00 x1875571085862016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684389.724992:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.725029:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085861888:0@lo:400:kworker.0 00000100:00100000:2.0:1788684389.725077:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.725267:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085861632 00000100:00100000:2.0:1788684389.725273:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085861632 00000100:00100000:2.0:1788684389.725300:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085861504 00000100:00100000:2.0:1788684389.725303:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085861504 00000100:00100000:2.0:1788684389.725516:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684389.725531:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085861504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684389.725575:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085861504:12345-0@lo:400:kworker.0 Request processed in 45us (5243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684389.725581:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684389.725599:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684389.725603:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1875571085861632:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788684389.725651:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1875571085861632:12345-0@lo:8:kworker.0 Request processed in 46us (6591us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788684389.725657:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684389.725679:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085861248 00000100:00100000:2.0:1788684389.725683:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085861248 00000100:00100000:2.0:1788684389.725704:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085861888 00000100:00100000:2.0:1788684389.725706:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085861888 00000100:00100000:2.0:1788684389.725720:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684389.725726:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085861248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684389.725761:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085861248:12345-0@lo:400:kworker.0 Request processed in 36us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684389.725767:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684389.725776:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788684389.725781:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085861888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684389.725805:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085861888:12345-0@lo:400:kworker.0 Request processed in 24us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684389.725810:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788684389.725936:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876ce00 x1875571085861504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684389.725949:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085861504:0@lo:400:kworker.0 00000100:00100000:2.0:1788684389.725971:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085861120:0@lo:400:kworker.0 00010000:00080000:2.0:1788684389.725983:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876df80 x1875571085861760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684389.725991:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085861760:0@lo:400:kworker.0 00000100:00100000:2.0:1788684389.726027:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684389.726033:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684389.726037:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788684389.726040:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085861632:0@lo:8:kworker.0 00010000:00080000:2.0:1788684389.726173:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876e680 x1875571085861248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684389.726182:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085861248:0@lo:400:kworker.0 00010000:00080000:2.0:1788684389.726194:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664876c000 x1875571085861888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684389.726200:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085861888:0@lo:400:kworker.0 00000100:00100000:0.0:1788684389.729835:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085862016:0@lo:400:kworker.0 00000020:01000004:0.0:1788684389.731471:0:19503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788684389.731491:0:19503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d67482e0000) 00000020:00000080:0.0:1788684389.731523:0:19503:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788684389.731621:0:19503:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6646ccf000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788684389.731626:0:19503:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6646ccf000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788684389.731628:0:19503:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6646ccf000 3 00010000:00080000:0.0:1788684389.731663:0:19503:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6758ee1800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1788684389.734169:0:19503:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788684389.736319:0:19503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788684389.736802:0:19503:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788684389.736816:0:19503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x44bac02bd54ad757 00000100:00080000:1.0:1788684389.737265:0:19503:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788684389.737274:0:19503:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d6758ee1800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684389.737323:0:19503:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648600a80 x1875571085862144/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788684389.737357:0:19503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788684389.737921:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684389.737926:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684389.737929:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684389.737938:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788684389.738573:0:19503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788684389.738625:0:19490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788684389.738660:0:19490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788684389.738673:0:19490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.740524:0:19490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788684389.740644:0:19490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788684389.740647:0:19490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788684389.740648:0:19490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684389.740649:0:19490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684389.740651:0:19490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684389.740652:0:19490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684389.740653:0:19490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684389.740655:0:19490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684389.740656:0:19490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684389.740660:0:19490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788684389.740662:0:19490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684389.740663:0:19490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788684389.740664:0:19490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684389.740665:0:19490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684389.740666:0:19490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684389.740667:0:19490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684389.740668:0:19490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684389.740669:0:19490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684389.740670:0:19490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684389.740842:0:19490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788684389.740862:0:19490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085862272:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788684389.740930:0:19490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.741334:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085862144:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788684389.741400:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.744192:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085862272 00000100:00100000:1.0:1788684389.744206:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085862272 00000100:00100000:1.0:1788684389.744262:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788684389.744272:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085862272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788684389.744302:0:17165:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788684389.744316:0:17165:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788684389.746526:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085862144 00000100:00100000:0.0:1788684389.746611:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085862144 00000100:00100000:0.0:1788684389.746663:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684389.746672:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1875571085862144:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788684389.746705:0:18403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:0.0:1788684389.746747:0:18403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x44bac02bd54ad75e 00000004:00100000:0.0:1788684389.746764:0:18403:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788684389.746803:0:18403:0:(import.c:65:import_set_state_nolock()) ffff8d67749da800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684389.746897:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875571085862144:12345-0@lo:38:llog_process_th.0 Request processed in 225us (5496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684389.746906:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 20000000:01000000:1.0:1788684389.747573:0:17165:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788684389.747584:0:17165:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788684389.747875:0:17187:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788684389.747880:0:17187:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788684389.747899:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.747916:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad6d2 expref: 24 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.747924:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad6e0 expref: 24 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.747932:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.747966:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad6e0 expref: 24 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.747992:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad6e0 expref: 24 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684389.748007:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085862400:0@lo:104: 00000100:00100000:1.0:1788684389.748060:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684389.749861:0:19490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684389.749900:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085862400 00000100:00100000:3.0:1788684389.749908:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085862400 00000100:00100000:3.0:1788684389.749959:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788684389.749969:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085862400:12345-0@lo:104: 00010000:00010000:3.0:1788684389.749985:0:17154:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.750072:0:17154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788684389.750079:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085862400:12345-0@lo:104: Request processed in 112us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.750087:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788684389.752424:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684389.752436:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.752447:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684389.752452:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.752461:0:17160:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684389.752468:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684389.752474:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684389.752516:0:17160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.752523:0:17160:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684389.752559:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.752567:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647890200/0x44bac02bd54ad6e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad6e7 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.752595:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684389.752597:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684389.752599:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684389.753488:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085862528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684389.754135:0:17187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad6d2 expref: 24 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684389.754148:0:17187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad6d2 expref: 24 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684389.754160:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085862656:0@lo:104: 00000100:00100000:2.0:1788684389.754282:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.754282:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684389.754350:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788684389.754388:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085862400:0@lo:104: 00000100:00100000:1.0:1788684389.754451:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:19490:x1875571085862272:12345-0@lo:253:mount.lustre.0 Request processed in 10180us (13520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684389.754460:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788684389.754596:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085862656 00000100:00100000:3.0:1788684389.754602:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085862656 00010000:00080000:2.0:1788684389.754705:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648600a80 x1875571085862144/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684389.754716:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684389.754724:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788684389.754742:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788684389.754747:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788684389.754750:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6758ee1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788684389.754758:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085862144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788684389.754760:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684389.754775:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085862656:12345-0@lo:104: 00010000:00010000:3.0:1788684389.754789:0:17154:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.754852:0:17154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788684389.754858:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c986901f-6089-4802-a23d-1179db951431+3:17187:x1875571085862656:12345-0@lo:104: Request processed in 88us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.754865:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788684389.754911:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684389.754919:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684389.754922:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085862528 00000100:00100000:3.0:1788684389.754927:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085862528 00010000:00010000:2.0:1788684389.754932:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684389.754938:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.754946:0:17156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad6e0 expref: 24 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.754949:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684389.755008:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788684389.755015:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c986901f-6089-4802-a23d-1179db951431+24:3623:x1875571085862528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684389.755025:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684389.755030:0:17156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad6e0 expref: 24 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.755040:0:17156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad6e0 expref: 24 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.755068:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d5400/0x44bac02bd54ad6e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad6e0 expref: 24 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.755082:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684389.755110:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c986901f-6089-4802-a23d-1179db951431+23:3623:x1875571085862528:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684389.755116:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788684389.755184:0:19490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c986901f-6089-4802-a23d-1179db951431:19490:1875571085862272:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788684389.755197:0:19490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788684389.755201:0:19490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684389.755203:0:19490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788684389.755205:0:19490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684389.755207:0:19490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684389.755208:0:19490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684389.755210:0:19490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684389.755212:0:19490:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684389.755214:0:19490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684389.755215:0:19490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788684389.755228:0:19490:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 10000000:00010000:2.0:1788684389.755698:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684389.755705:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684389.755741:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.755748:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684389.755769:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.755777:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d5800/0x44bac02bd54ad6d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad6d9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.755791:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684389.755799:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684389.755801:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684389.755833:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085862528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684389.755835:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085862784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684389.755874:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684389.756687:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085862784 00000100:00100000:2.0:1788684389.756693:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085862784 00010000:00010000:2.0:1788684389.756714:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad6d2 expref: 23 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684389.756746:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788684389.756754:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+23:3624:x1875571085862784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684389.756763:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684389.756768:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad6d2 expref: 23 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.756778:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad6d2 expref: 23 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.756794:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.756802:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788684389.756817:0:17158:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008936149s 00010000:00010000:2.0:1788684389.756835:0:17158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.756842:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.756849:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711c800/0x44bac02bd54ad6d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad6d2 expref: 23 pid: 17164 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.756851:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.756865:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684389.756867:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17187:1875571085862656:0@lo:104: 00010000:00010000:2.0:1788684389.756878:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684389.756883:0:17158:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.756890:0:17158:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.756895:0:17187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.756900:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.756911:0:17187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684389.756914:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788684389.756922:0:17187:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684389.756938:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b0000/0x44bac02bd54ad765 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684389.757021:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+22:3624:x1875571085862784:12345-0@lo:103:ldlm_bl.0 Request processed in 268us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684389.757027:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788684389.757093:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085862784:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788684389.758434:0:19490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788684389.761906:0:19490:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788684389.761916:0:19490:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788684389.761950:0:19490:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788684389.761992:0:19490:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788684389.762013:0:19490:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788684389.762035:0:19490:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788684389.764490:0:19490:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684389.767968:0:19490:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788684390.142291:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788684390.649993:0:19556:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684390.650239:0:19556:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788684390.782935:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684369/real 1788684369] req@ffff8d66479a4000 x1875571085849088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684389 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.782963:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a4000 x1875571085849088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684389 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.782974:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684369/real 1788684369] req@ffff8d66479a5180 x1875571085849216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684389 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.782985:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d66479a5180 x1875571085849216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684389 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788684390.783004:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf21800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684390.783037:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788684390.783041:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085849088:0@lo:8:kworker.0 00000100:00080000:3.0:1788684390.783047:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf25000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684390.783052:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788684390.783054:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085849216:0@lo:8:kworker.0 00000100:00080000:2.0:1788684390.783247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684390.783251:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788684390.783261:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677cf21800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684390.783266:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1788684390.783271:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788684390.783278:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d677cf21800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684390.783313:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876d880 x1875571085863168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684390.783325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684390.783328:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788684390.783329:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677cf25000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684390.783332:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1788684390.783334:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788684390.783338:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d677cf25000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684390.783348:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876c000 x1875571085863296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684390.783423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684390.783427:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788684390.783428:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684390.783433:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d6775fa6000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684390.783444:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664876fb80 x1875571085863808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684390.783489:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085863424:0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.783549:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684390.783591:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085864064:0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.783615:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684390.783642:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788684390.783647:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085863552:0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.783670:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684390.783696:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085864192:0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.783723:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684390.783756:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085863424 00000100:00100000:2.0:1788684390.783762:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085863424 00000100:00100000:2.0:1788684390.783798:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085864064 00000100:00100000:2.0:1788684390.783801:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085864064 00000100:00100000:2.0:1788684390.783834:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085864192 00000100:00100000:2.0:1788684390.783837:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085864192 00000100:00100000:2.0:1788684390.783853:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684390.783861:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085863424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.783911:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085863424:12345-0@lo:400:kworker.0 Request processed in 50us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684390.783918:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684390.783934:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684390.783940:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085864064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.783969:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085864064:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684390.783975:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684390.783986:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684390.783992:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085864192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.784015:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085864192:12345-0@lo:400:kworker.0 Request processed in 24us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684390.784021:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788684390.784353:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664859a300 x1875571085864192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684390.784398:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085864192:0@lo:400:kworker.0 00010000:00080000:2.0:1788684390.784411:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664876e680 x1875571085863424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684390.784419:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085863424:0@lo:400:kworker.0 00010000:00080000:2.0:1788684390.784428:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648598a80 x1875571085864064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684390.784435:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085864064:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.786732:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085862912:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.786805:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.786866:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085863680:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.786898:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.786927:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085864320:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.786955:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.786982:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788684390.786990:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085863040:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.787012:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.787169:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085863936:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.787196:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.787216:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085864448:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.787242:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.787272:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085864320 00000100:00100000:3.0:1788684390.787279:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085864320 00000100:00100000:2.0:1788684390.787780:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085862912 00000100:00100000:2.0:1788684390.787786:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085862912 00000100:00100000:2.0:1788684390.787846:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788684390.787856:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:3625:x1875571085862912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.787917:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:3625:x1875571085862912:12345-0@lo:400:kworker.0 Request processed in 63us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684390.787924:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788684390.787957:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085863680 00000100:00100000:2.0:1788684390.787961:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085863680 00000100:00100000:2.0:1788684390.787989:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684390.787995:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085863680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.788026:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085863680:12345-0@lo:400:kworker.0 Request processed in 32us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.788147:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085863936 00000100:00100000:3.0:1788684390.788150:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085863936 00000100:00100000:3.0:1788684390.788159:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085864448 00000100:00100000:3.0:1788684390.788161:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085864448 00000100:00100000:3.0:1788684390.788173:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788684390.788179:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085864320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.788212:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085864320:12345-0@lo:400:kworker.0 Request processed in 33us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.788218:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788684390.788229:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684390.788233:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085863936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.788257:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085863936:12345-0@lo:400:kworker.0 Request processed in 23us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.788262:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684390.788273:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684390.788278:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085864448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684390.788390:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788684390.788596:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085863552 00000100:00100000:0.0:1788684390.788601:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085863552 00000100:00100000:0.0:1788684390.788642:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085863040 00000100:00100000:0.0:1788684390.788645:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085863040 00000100:00100000:0.0:1788684390.788659:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684390.788665:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085863552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684390.788721:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085863552:12345-0@lo:400:kworker.0 Request processed in 56us (5050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684390.788728:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684390.788741:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788684390.788747:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085863040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684390.788775:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085863040:12345-0@lo:400:kworker.0 Request processed in 28us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684390.788780:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788684390.788809:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684390.788826:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684390.788828:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684390.788861:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085863552:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.790246:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085864448:12345-0@lo:400:kworker.0 Request processed in 1964us (2999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.790256:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684390.790782:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085863168:0@lo:8:kworker.0 00000100:00100000:3.0:1788684390.790840:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.792176:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085863296:0@lo:8:kworker.0 00000100:00100000:3.0:1788684390.792239:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.802100:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085863040:0@lo:400:kworker.0 00010000:00080000:3.0:1788684390.802121:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664876ce00 x1875571085863936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.802132:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085863936:0@lo:400:kworker.0 00010000:00080000:3.0:1788684390.802144:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664859b800 x1875571085864448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.802152:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085864448:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.802162:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085862912:0@lo:400:kworker.0 00010000:00080000:3.0:1788684390.802173:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664876df80 x1875571085863680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.802181:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085863680:0@lo:400:kworker.0 00010000:00080000:3.0:1788684390.802191:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664859a680 x1875571085864320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.802198:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085864320:0@lo:400:kworker.0 00000100:00100000:3.0:1788684390.802323:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085863808:0@lo:8:kworker.0 00000100:00100000:3.0:1788684390.802519:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684390.802528:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085863168 00000100:00100000:2.0:1788684390.802984:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085863168 00000100:00100000:2.0:1788684390.803025:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085863296 00000100:00100000:2.0:1788684390.803115:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085863296 00000100:00100000:2.0:1788684390.803381:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684390.803389:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1875571085863168:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788684390.803417:0:19204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1788684390.803446:0:19204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ad76c 00002000:00100000:2.0:1788684390.803462:0:19204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d6646589000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788684390.803467:0:19204:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788684390.803470:0:19204:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788684390.803759:0:19204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788684390.803784:0:19204:0:(import.c:65:import_set_state_nolock()) ffff8d664658f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684390.803865:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1875571085863168:12345-0@lo:8:kworker.0 Request processed in 475us (13023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684390.803872:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684390.803889:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788684390.803893:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1875571085863296:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788684390.803910:0:19204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1788684390.803926:0:19204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ad773 00002000:00100000:2.0:1788684390.803934:0:19204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d6646589800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788684390.803937:0:19204:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788684390.803939:0:19204:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788684390.804161:0:19204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788684390.804177:0:19204:0:(import.c:65:import_set_state_nolock()) ffff8d664658b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684390.804208:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3622:x1875571085863296:12345-0@lo:8:kworker.0 Request processed in 313us (11970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684390.804215:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788684390.805882:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664876d880 x1875571085863168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.805896:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788684390.805906:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788684390.805917:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788684390.805923:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788684390.805926:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf21800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788684390.805947:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788684390.805953:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085863168:0@lo:8:kworker.0 00000004:00080000:2.0:1788684390.805962:0:17195:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:3.0:1788684390.805982:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664876c000 x1875571085863296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.805990:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788684390.805994:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788684390.805999:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788684390.806003:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788684390.806005:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf25000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788684390.806018:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788684390.806022:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085863296:0@lo:8:kworker.0 00000004:00080000:2.0:1788684390.806071:0:17195:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471799704043ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788684390.806078:0:17195:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788684390.806090:0:17198:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788684390.806112:0:17198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17198:1875571085864704:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788684390.806164:0:17198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.806335:0:17198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1ef00 going to sleep for 11 seconds 00000004:00080000:3.0:1788684390.806348:0:17197:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788684390.806433:0:17197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471800066078ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788684390.806438:0:17197:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788684390.806457:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684390.806468:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085864576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684390.806501:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684390.806653:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085863808 00000100:00100000:1.0:1788684390.806659:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085863808 00000100:00100000:1.0:1788684390.806687:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085864704 00000100:00100000:1.0:1788684390.806690:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085864704 00000100:00100000:1.0:1788684390.806729:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788684390.806746:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1875571085863808:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788684390.806774:0:19204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1788684390.806802:0:19204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ad77a 00002000:00100000:1.0:1788684390.806826:0:19204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d6646cc7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788684390.806831:0:19204:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788684390.806833:0:19204:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788684390.806874:0:19204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788684390.806895:0:19204:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684390.806938:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3622:x1875571085863808:12345-0@lo:8:kworker.0 Request processed in 193us (4420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684390.806946:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788684390.806962:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788684390.807099:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17198:x1875571085864704:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788684390.807329:0:17196:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788684390.807344:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648601500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17196:1875571085864960:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788684390.807563:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085864576 00000100:00100000:3.0:1788684390.807568:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085864576 00000100:00100000:3.0:1788684390.807599:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684390.807607:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085864576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788684390.807620:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788684390.807665:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085864576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.807671:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684390.807689:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684390.807699:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085864832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684390.807745:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.807772:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085864832 00000100:00100000:3.0:1788684390.807775:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085864832 00000100:00100000:3.0:1788684390.807799:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788684390.807805:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085864832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684390.807834:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684390.807868:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085864832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.807874:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788684390.807905:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648602680 x1875571085864832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.807922:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085864832:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788684390.807951:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664876fb80 x1875571085863808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684390.808252:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684390.808270:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743c50540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684390.808497:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085864960 00000100:00100000:1.0:1788684390.808502:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085864960 00000100:00100000:1.0:1788684390.808525:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788684390.808531:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17196:x1875571085864960:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:1.0:1788684390.808692:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fbc0e00 x1875571085864576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684390.808706:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085864576:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788684390.809223:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788684390.809233:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788684390.809238:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788684390.809242:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788684390.809265:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788684390.809271:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085863808:0@lo:8:kworker.0 00000004:00080000:0.0:1788684390.809459:0:17915:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788684390.809467:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085865088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684390.809482:0:17915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17915:1875571085865216:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788684390.809521:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684390.809527:0:17915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684390.809553:0:17915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746d639c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684390.809563:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085865088 00000100:00100000:3.0:1788684390.809569:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085865088 00000100:00100000:3.0:1788684390.809603:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788684390.809610:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085865088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788684390.809623:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788684390.809662:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085865088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.809671:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788684390.809701:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6747a6d180 x1875571085865088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.809714:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085865088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684390.810520:0:18680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788684390.810532:0:18680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788684390.811230:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085865216 00000100:00100000:0.0:1788684390.811238:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085865216 00000100:00080000:0.0:1788684390.811278:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684390.811358:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788684390.811363:0:17914:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788684390.811461:0:17914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 471805093921ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788684390.811470:0:17914:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:3.0:1788684390.811679:0:19204:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788684390.811687:0:19204:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788684390.811692:0:19204:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:0.0:1788684390.812491:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684390.812503:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17915:x1875571085865216:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788684390.819493:0:17151:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788684390.819516:0:17151:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788684390.823983:0:18677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788684390.823995:0:18677:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788684390.824001:0:18677:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:1.0:1788684390.827727:0:17903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:3.0:1788684390.835145:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.835161:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.835192:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.835198:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.835207:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.835230:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.835242:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.835251:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.835273:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.835666:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.835689:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.835704:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711da00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.835709:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.835723:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.835752:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.835760:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000412c342c/0x44bac02bd54ad781 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.835792:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.835794:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.835795:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684390.836521:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.836531:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836548:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.836552:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.836569:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836583:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836612:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836620:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836638:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.836650:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.836656:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836664:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.836670:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836679:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836696:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836717:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ad788 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.836749:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.836752:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.836754:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788684390.843742:0:19567:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788684390.843757:0:19567:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788684390.843898:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17915:x1875571085865216:12345-0@lo:7:osp-pre-1-1.0 Request processed in 31391us (34367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.843910:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00010000:3.0:1788684390.845636:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.845654:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.845675:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.845680:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.845698:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.845715:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.845726:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.845734:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.845757:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788684390.845971:0:17915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17915:1875571085865216:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788684390.845990:0:17915:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788684390.846040:0:17915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17915:1875571085865344:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788684390.846112:0:17915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684390.846194:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.846205:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.846216:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711c800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.846222:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.846233:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.846259:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.846268:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a667aa58/0x44bac02bd54ad78f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684390.846270:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085865344 00000100:00100000:3.0:1788684390.846280:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085865344 00010000:00010000:2.0:1788684390.846309:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.846312:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.846316:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684390.846361:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788684390.846395:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17915:x1875571085865344:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788684390.846430:0:18680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 10000000:01000000:1.0:1788684390.846533:0:17168:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788684390.846540:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d678003e800 from 10 10000000:01000000:1.0:1788684390.846544:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:3.0:1788684390.846552:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17915:x1875571085865344:12345-0@lo:5:osp-pre-1-1.0 Request processed in 155us (434us total) trans 0 rc 0/0 00002000:00010000:2.0:1788684390.846554:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1788684390.846562:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788684390.846562:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.846572:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.846576:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.846580:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.846651:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.846663:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.846673:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684390.846688:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085865472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788684390.846732:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684390.846741:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684390.846754:0:17915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746d639c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788684390.846755:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.846770:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684390.846782:0:17915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17915:1875571085865344:0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1788684390.846797:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788684390.846809:0:17915:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788684390.846850:0:17915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17915:1875571085865600:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788684390.846873:0:17915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684390.846888:0:17915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746d639c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788684390.846928:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.846937:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.846945:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.846949:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.846968:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.846985:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.846993:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048410d1b/0x44bac02bd54ad796 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.847025:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.847028:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.847031:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684390.847059:0:19567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085865600 00000100:00100000:3.0:1788684390.847066:0:19567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085865600 00000100:00100000:1.0:1788684390.847066:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684390.847095:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085865472 00000100:00100000:1.0:1788684390.847102:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085865472 00000100:00100000:3.0:1788684390.847125:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788684390.847149:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17915:x1875571085865600:12345-0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788684390.847163:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788684390.847180:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+22:17168:x1875571085865472:12345-0@lo:101:ll_cfg_requeue.0 00002000:00080000:3.0:1788684390.847187:0:18680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:1.0:1788684390.847196:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684390.847217:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad7a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad79d expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.847244:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad79d expref: 23 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.847254:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad79d expref: 23 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.847273:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0a00, rc 0) 00000100:00100000:1.0:1788684390.847334:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085865472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (602us total) trans 0 rc 0/0 00002000:00010000:2.0:1788684390.847514:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.847527:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847540:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.847544:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.847550:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847573:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847664:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847675:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847690:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.847700:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.847705:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847712:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.847716:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847725:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847739:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847748:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad7ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.847769:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.847771:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.847773:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684390.848648:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.848659:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848675:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.848707:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.848715:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848733:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848842:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848851:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848876:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684390.848889:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684390.848894:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848919:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.848923:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848932:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848947:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848954:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad7b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.848970:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.848971:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.848973:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684390.850509:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.850525:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850545:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.850550:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.850557:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850572:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850581:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850588:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850607:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.850747:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.850754:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850775:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.850781:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850792:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850859:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850869:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad7b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850890:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.850892:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.850894:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684390.850940:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.850947:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850957:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.850961:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.850965:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850974:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850990:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.850997:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.851020:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684390.851037:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684390.851053:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.851066:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.851072:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.851522:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.851559:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.851567:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017af4c67/0x44bac02bd54ad7c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684390.851662:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.851667:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.851671:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.851673:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.851686:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.851690:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.851695:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.851706:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.851714:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.851781:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.851918:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684390.852758:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00002000:00010000:0.0:1788684390.852960:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.852972:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.852988:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.852993:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.853001:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.853017:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.853030:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.853039:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.853214:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684390.853227:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684390.853233:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.853242:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.853247:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.853257:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.853275:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.853361:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad7ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.853422:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.853425:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.853429:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684390.854209:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085865472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684390.854384:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.854398:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684390.854507:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085865728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788684390.854712:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.854766:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c300 going to sleep for 11 seconds 00002000:00010000:0.0:1788684390.855163:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.855176:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855191:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.855205:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.855212:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855227:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855236:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855245:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855265:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684390.855275:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684390.855291:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855299:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.855304:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855312:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855327:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855347:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad7d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.855855:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.855858:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.855859:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.855954:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684390.855993:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684390.856000:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.856010:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.856015:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.856024:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.856046:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.856055:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d932917f/0x44bac02bd54ad7c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.856116:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.856122:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.856126:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684390.857749:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.857763:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.857784:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.857790:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.857797:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.857832:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684390.857846:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085865728 00010000:00010000:2.0:1788684390.857847:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.857858:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684390.857863:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085865728 00010000:00010000:2.0:1788684390.857879:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788684390.857966:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788684390.857982:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085865728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788684390.858031:0:17164:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788684390.858067:0:17164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788684390.858071:0:17164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788684390.858275:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085865728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 298us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.858285:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00002000:00010000:2.0:1788684390.858395:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.858403:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.858413:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.858425:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.858430:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.858444:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.858453:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.858461:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.858481:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788684390.858500:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085865728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788684390.858596:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788684390.858606:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.858616:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684390.858641:0:17168:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788684390.858645:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d66484cb800 from 10 10000000:01000000:3.0:1788684390.858649:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788684390.858701:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.858710:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.858732:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684390.858762:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085865856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788684390.858830:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.858888:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788684390.858918:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085865856 00000100:00100000:3.0:1788684390.858925:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085865856 00000100:00100000:3.0:1788684390.858970:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788684390.858979:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085865856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684390.858991:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684390.859013:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ad7f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad7ea expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.859039:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ad7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad7ea expref: 24 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.859051:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ad7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad7ea expref: 24 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.859062:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1800, rc 0) 00000100:00100000:3.0:1788684390.859101:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:17168:x1875571085865856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.859111:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00002000:00010000:2.0:1788684390.859547:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.859555:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.859567:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.859570:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.859575:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.859586:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.859610:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.859628:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.859640:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788684390.859722:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085865856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684390.859741:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.859758:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684390.859852:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085865984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788684390.859901:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.859928:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788684390.859945:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085865984 00000100:00100000:3.0:1788684390.859950:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085865984 00000100:00100000:3.0:1788684390.859980:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788684390.859988:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:17168:x1875571085865984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788684390.860005:0:17163:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788684390.860021:0:17163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788684390.860025:0:17163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788684390.860104:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:17168:x1875571085865984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.860112:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788684390.860223:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085865984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788684390.860283:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788684390.860291:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.860300:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788684390.861617:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.861743:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.861770:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.861776:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.861784:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.861799:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.861811:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.861831:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.861847:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788684390.861864:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788684390.861881:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.861896:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.861902:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.861913:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.861935:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.861943:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ad7dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.861969:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788684390.861973:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.861980:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.861984:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.861991:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862018:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862026:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ad7e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862044:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684390.862047:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862054:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.862059:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862066:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862075:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862082:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ad7f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862093:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684390.862097:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862114:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.862117:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862125:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862141:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862150:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d8afab2/0x44bac02bd54ad7ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.862171:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.862176:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.862178:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.862463:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.862536:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.862544:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.862556:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.862560:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.862569:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.862582:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.862598:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.862605:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863235:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788684390.863451:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.863460:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863474:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.863478:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.863483:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863494:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863502:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863510:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863537:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788684390.863547:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684390.863553:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863561:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.863566:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863575:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863594:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863602:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000590c7c3f/0x44bac02bd54ad806 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863714:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.863718:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863726:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.863730:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863752:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.863757:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.863765:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863775:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54ad80d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.863800:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.863803:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.863805:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.865746:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.865766:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.865788:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.865795:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.865803:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.865834:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.865847:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.865865:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866024:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788684390.866277:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.866284:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866294:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.866298:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.866303:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866347:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866362:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866404:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788684390.866464:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.866471:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866492:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.866511:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.866516:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866526:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866534:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866542:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866558:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788684390.866569:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684390.866575:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866584:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.866589:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.866599:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.868145:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.868165:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fa89137/0x44bac02bd54ad814 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.868191:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.868197:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.868268:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.868276:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.868287:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.868306:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.868314:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000394703aa/0x44bac02bd54ad822 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.868332:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.868334:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.868344:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.872570:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684390.872597:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.872608:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.872624:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.872643:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.872657:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.872683:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.872691:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ad81b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.872718:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.872720:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.872723:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.875097:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.875982:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.875998:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876020:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.876025:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.876041:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876060:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876073:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876082:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876104:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684390.876122:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.876129:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876137:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.876142:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876151:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876170:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876192:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d658f48/0x44bac02bd54ad829 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876213:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.876216:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.876218:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.876272:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.876279:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876287:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.876291:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.876295:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876306:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876313:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876320:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.876335:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788684390.878646:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.878666:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878788:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.878794:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.878801:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878827:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878839:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878848:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878868:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788684390.878881:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684390.878887:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878895:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.878899:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878908:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878931:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878941:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2297ed4/0x44bac02bd54ad830 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878960:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.878964:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878970:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.878975:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878983:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878991:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.878998:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad837 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879009:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.879011:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.879017:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.879854:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.879862:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879874:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.879878:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.879882:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879894:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879901:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879909:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879921:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684390.879930:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.879934:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879941:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.879945:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879966:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879979:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.879986:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071de46d3/0x44bac02bd54ad83e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880000:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.880002:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.880003:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.880033:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.880037:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880045:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.880048:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.880052:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880062:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880069:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880083:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880093:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684390.880099:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.880102:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880110:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.880114:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880122:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880132:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880139:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad845 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.880162:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.880163:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.880165:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.883008:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.885201:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.885232:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885249:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.885254:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.885262:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885278:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885300:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885307:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885328:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684390.885341:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.885346:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885355:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.885360:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885425:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885470:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885479:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad84c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.885500:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.885502:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.885504:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684390.887162:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.887174:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887190:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.887195:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.887202:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887230:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887241:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887249:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887268:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684390.887280:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684390.887286:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887294:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684390.887300:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887309:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887327:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887335:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad853 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.887416:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.887420:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684390.887422:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684390.889002:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.889017:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.889037:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.889043:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.889051:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.889068:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.889080:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.889089:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.889201:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684390.889545:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684390.889555:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.889565:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.889571:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.889582:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.889611:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.889621:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006106b5ea/0x44bac02bd54ad85a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.889644:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.889647:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.889649:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684390.891284:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684390.891298:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891327:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788684390.891333:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684390.891340:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891357:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891393:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891402:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891427:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684390.891442:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684390.891447:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891456:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.891461:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891471:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891503:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891510:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbc1049e/0x44bac02bd54ad861 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.891531:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.891533:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.891535:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.895030:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.895044:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.895062:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.895067:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.895074:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.895089:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.895100:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.895108:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.895717:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684390.896343:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684390.896359:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.896392:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.896398:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.896412:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.896438:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.896447:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087bedd07/0x44bac02bd54ad868 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.896492:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.896494:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.896496:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.897052:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.897064:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.897079:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.897082:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.897088:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.897100:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.897111:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.897119:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684390.898120:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.898139:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.898166:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.898171:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.898177:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.898195:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.898205:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.898212:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.898443:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788684390.898576:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788684390.899015:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684390.899027:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899041:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.899046:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899056:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899078:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899086:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071de46d3/0x44bac02bd54ad86f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899109:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684390.899113:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899120:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.899131:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899140:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899152:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899160:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad876 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.899177:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.899179:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.899181:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.899528:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684390.899893:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.899903:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.899917:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.899922:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.899927:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.899940:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.899958:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.899966:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.899985:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.899995:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.900001:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900009:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.900013:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900022:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900035:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900043:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad87d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900058:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.900066:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.900068:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684390.900668:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.900676:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900687:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.900691:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.900696:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900707:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900715:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900722:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900739:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.900748:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.900752:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900760:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.900764:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900785:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900798:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900805:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad884 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.900832:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.900834:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.900836:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684390.901854:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.902006:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902023:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.902027:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.902033:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902045:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902054:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902072:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902092:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.902104:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.902110:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902118:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.902123:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902132:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902150:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902160:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad88b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.902190:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.902193:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.902195:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.904037:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.904051:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.904069:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.904082:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.904090:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.904106:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684390.904108:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.904131:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.904146:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.904184:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.904186:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.904199:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.904215:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.904233:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.904234:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.904253:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.904263:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.904328:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788684390.906246:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684390.906262:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906278:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.906284:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906297:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906325:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906339:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000706ba891/0x44bac02bd54ad892 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906442:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684390.906448:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906456:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.906459:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906466:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906478:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906485:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad899 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.906513:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.906515:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.906518:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684390.907317:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684390.907331:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.907347:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788684390.907351:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684390.907358:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.907397:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.907411:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.907446:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.907471:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684390.907507:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684390.907515:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.907533:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.907538:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.907547:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.907564:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.907573:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a6b9ed/0x44bac02bd54ad8a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.907592:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.907595:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.907597:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684390.908265:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684390.908275:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.908288:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788684390.908292:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684390.908297:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.908308:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.908327:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.908336:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.908360:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684390.908557:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.908565:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.908574:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.908578:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.908588:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.908604:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.908612:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbc1049e/0x44bac02bd54ad8a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.908631:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.908633:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.908636:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684390.909170:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684390.909178:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909189:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788684390.909193:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684390.909198:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909210:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909218:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909225:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909259:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684390.909589:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.909597:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.909613:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.909617:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.909627:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.909642:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.909650:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000207900e5/0x44bac02bd54ad8ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.909668:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.909670:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.909672:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684390.909809:0:19204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684390.909826:0:19204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909835:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788684390.909839:0:19204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684390.909844:0:19204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909854:0:19204:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909863:0:19204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909870:0:19204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.909894:0:19204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788684390.909933:0:19204:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1788684390.910057:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17198:x1875571085864704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 103083us (103887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684390.910067:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788684390.910266:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.910272:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.910279:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.910283:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.910292:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.910314:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.910323:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f845275/0x44bac02bd54ad8b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.910339:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.910341:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.910343:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684390.910434:0:17198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17198:1875571085864704:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788684390.910462:0:17198:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788684390.910520:0:17198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17198:1875571085866112:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788684390.910568:0:17198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684390.910597:0:17198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684390.910665:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085866112 00000100:00100000:3.0:1788684390.910673:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085866112 00000100:00100000:3.0:1788684390.910738:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788684390.910749:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17198:x1875571085866112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788684390.910794:0:18679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1788684390.911386:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684390.918461:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.918477:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.918496:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.918501:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.918508:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.918524:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.918536:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.918544:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.918562:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684390.918682:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684390.918691:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.918699:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684390.918705:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.918715:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.918734:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.918762:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0d211f1/0x44bac02bd54ad8bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684390.918780:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.918783:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684390.918784:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684390.920754:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.920765:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.920793:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.920797:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.920804:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.920828:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.920838:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.920846:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.920869:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788684390.921271:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.921277:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.921383:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.921387:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.921392:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.921402:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.921423:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.921430:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.921449:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788684390.921941:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684390.921957:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922003:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.922011:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922026:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922057:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922066:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b8742cb/0x44bac02bd54ad8c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922097:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684390.922101:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922108:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.922129:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922137:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922150:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922157:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1b55bc2/0x44bac02bd54ad8ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.922172:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.922174:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.922176:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788684390.923439:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00002000:00010000:0.0:1788684390.924440:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.924453:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.924471:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.924475:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.924482:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.924496:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.924508:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.924515:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.924547:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684390.925758:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684390.925773:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.925789:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.925795:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.925809:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.925848:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.925867:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028a6b38/0x44bac02bd54ad8d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.925897:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.925901:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.925905:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788684390.926358:0:19491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1788684390.926460:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788684390.926460:0:19491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788684390.926473:0:19491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788684390.926695:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.926704:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.926720:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.926724:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.926730:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.926743:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.926752:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.926759:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.926778:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684390.927248:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684390.927259:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.927271:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3e200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684390.927276:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.927288:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.927309:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.927318:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebd82850/0x44bac02bd54ad8d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.927356:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.927360:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684390.927388:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684390.927909:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17198:x1875571085866112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17155us (17335us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788684390.927923:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684390.928103:0:17198:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788684390.928117:0:17198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17198:1875571085866112:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788684390.928141:0:17198:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00002000:00010000:1.0:1788684390.932006:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684390.932026:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.932049:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=471s v=(0 0) 00010000:00010000:1.0:1788684390.932273:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684390.932282:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.932301:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.932313:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.932322:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684390.932989:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.935968:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.935990:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.936007:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.936013:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.936043:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.936074:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.936085:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0f3be63/0x44bac02bd54ad8df lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.936121:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.936124:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.936127:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684390.936478:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684390.936495:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.936512:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788684390.936530:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684390.936538:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.936553:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.936564:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.936879:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684390.936907:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684390.936972:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.936983:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.936994:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3fe00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.936999:0:17160:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.937009:0:17160:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.937026:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.937049:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf14f769/0x44bac02bd54ad8e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.937068:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.937071:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.937072:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788684390.937255:0:19491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00002000:00010000:2.0:1788684390.937403:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.937412:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.937424:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.937429:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.937435:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.937446:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.937455:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.937464:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.937485:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788684390.937989:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.938003:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938014:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.938017:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.938021:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938032:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938040:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938049:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938067:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788684390.938317:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.938323:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938332:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.938335:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.938339:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938348:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938390:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938398:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.938407:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788684390.939463:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.939474:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.939490:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.939495:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.939500:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.939513:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.939522:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.939530:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.939554:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788684390.940068:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.940074:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.940085:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.940088:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.940094:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.940103:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.940112:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.940119:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.940130:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788684390.940961:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.940971:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.940986:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.940995:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.941001:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.941013:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.941023:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.941030:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.941040:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788684390.941922:0:18677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684390.941932:0:18677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.941945:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788684390.941948:0:18677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684390.941953:0:18677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.941965:0:18677:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.941973:0:18677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.941987:0:18677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.941997:0:18677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00080000:2.0:1788684390.942048:0:18677:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788684390.942173:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17196:x1875571085864960:12345-0@lo:5:osp-pre-0-0.0 Request processed in 133636us (133916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684390.942184:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788684390.942232:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788684390.942241:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942250:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.942254:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942265:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942289:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942299:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000423e241a/0x44bac02bd54ad8ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942337:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788684390.942342:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942349:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.942352:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942360:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942404:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942411:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ad8f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942426:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788684390.942431:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942438:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.942441:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942462:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942476:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942483:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce34e32a/0x44bac02bd54ad8fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942499:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788684390.942503:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942510:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.942514:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684390.942524:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648601500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17196:1875571085864960:0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1788684390.942526:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942552:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788684390.942555:0:17196:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00010000:00010000:2.0:1788684390.942577:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096fcff35/0x44bac02bd54ad902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942607:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788684390.942611:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942619:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.942623:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942633:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684390.942640:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17196:1875571085866240:0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1788684390.942648:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942657:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ad909 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942672:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684390.942675:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.942696:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.942700:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684390.942724:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684390.942736:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684390.942759:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746d63540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684390.942952:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085866240 00000100:00100000:1.0:1788684390.942964:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085866240 00000100:00100000:1.0:1788684390.943025:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684390.943037:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17196:x1875571085866240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788684390.943089:0:19204:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:2.0:1788684390.944101:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.944111:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006106b5ea/0x44bac02bd54ad910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.944134:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684390.944139:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.944148:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684390.944152:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.944161:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.944170:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.944177:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cf9e752/0x44bac02bd54ad917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684390.944206:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.944208:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.944210:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684390.944253:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684390.952530:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17915:x1875571085865600:12345-0@lo:5:osp-pre-1-1.0 Request processed in 105386us (105645us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788684390.952547:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788684390.953672:0:17915:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788684390.954677:0:17915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17915:1875571085865600:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788684390.954727:0:17915:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788684390.954822:0:17915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17915:1875571085866368:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788684390.954890:0:17915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684390.954919:0:17915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750aca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684390.954954:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085866368 00000100:00100000:3.0:1788684390.954960:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085866368 00000100:00100000:3.0:1788684390.955018:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684390.955026:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17915:x1875571085866368:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788684390.955081:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17915:x1875571085866368:12345-0@lo:900:osp-pre-1-1.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684390.955097:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788684390.955547:0:17915:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fbc0e00 x1875571085866368/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788684406 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684390.955562:0:17915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17915:1875571085866368:0@lo:900:osp-pre-1-1.0 00000001:00080000:0.0:1788684390.958758:0:18674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788684390.958830:0:18674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788684390.959134:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17196:x1875571085866240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16094us (16413us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788684390.959147:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684390.959252:0:17196:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788684390.959263:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17196:1875571085866240:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788684390.959284:0:17196:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788684391.174980:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684392.192841:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684393.217531:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684394.109530:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085866624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684394.109536:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085866496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684394.112419:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684394.112513:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085866496 00000100:00100000:2.0:1788684394.112525:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085866496 00000100:00100000:2.0:1788684394.112572:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684394.112581:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085866496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684394.112614:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788684394.112648:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788684394.112665:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085866496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684394.112673:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788684394.112755:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085866752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684394.112791:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684394.112850:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085866496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684394.113307:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085866752 00000100:00100000:2.0:1788684394.113313:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085866752 00000100:00100000:2.0:1788684394.113347:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684394.113354:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085866752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684394.113394:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684394.113434:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085866752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684394.113441:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684394.113478:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085866752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788684394.113789:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684394.113916:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684394.114009:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085866624 00000100:00100000:0.0:1788684394.114014:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085866624 00000100:00100000:0.0:1788684394.114051:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684394.114059:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085866624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684394.114078:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788684394.114136:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085866624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684394.114143:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788684394.114263:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085866624:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684394.239978:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684395.266528:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684396.157963:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085866880:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158032:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158079:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085867392:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158101:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158118:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085867904:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158135:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158148:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085868416:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158163:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158183:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788684396.158188:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085867008:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158210:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158226:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085867520:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158245:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158262:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085868032:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158279:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158303:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085867136:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158329:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158347:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085867648:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158382:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158398:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085868160:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158415:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158424:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788684396.158428:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085867264:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158447:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158460:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085867776:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158487:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158503:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085868288:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158522:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684396.158544:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085866880 00000100:00100000:2.0:1788684396.158550:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085866880 00000100:00100000:2.0:1788684396.158587:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788684396.158594:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:3625:x1875571085866880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.158637:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:3625:x1875571085866880:12345-0@lo:400:kworker.0 Request processed in 43us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684396.158644:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788684396.158874:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085867008 00000100:00100000:0.0:1788684396.158879:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085867008 00000100:00100000:0.0:1788684396.158902:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085867520 00000100:00100000:0.0:1788684396.158904:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085867520 00000100:00100000:0.0:1788684396.158914:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684396.158920:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085867008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.158954:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085867008:12345-0@lo:400:kworker.0 Request processed in 34us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684396.158959:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684396.158972:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684396.158977:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085867520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.159008:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085867520:12345-0@lo:400:kworker.0 Request processed in 30us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684396.159014:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684396.159034:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085867392 00000100:00100000:0.0:1788684396.159037:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085867392 00000100:00100000:0.0:1788684396.159054:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085867904 00000100:00100000:0.0:1788684396.159057:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085867904 00000100:00100000:0.0:1788684396.159064:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085868416 00000100:00100000:0.0:1788684396.159066:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085868416 00000100:00100000:0.0:1788684396.159086:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085868032 00000100:00100000:0.0:1788684396.159089:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085868032 00000100:00100000:0.0:1788684396.159100:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085868160 00000100:00100000:0.0:1788684396.159102:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085868160 00000100:00100000:0.0:1788684396.159113:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085868288 00000100:00100000:0.0:1788684396.159115:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085868288 00000100:00100000:0.0:1788684396.159125:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684396.159131:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085867392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.159158:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085867392:12345-0@lo:400:kworker.0 Request processed in 28us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684396.159165:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684396.159176:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684396.159182:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085867904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.159207:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085867904:12345-0@lo:400:kworker.0 Request processed in 26us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684396.159213:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684396.159223:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684396.159228:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085868416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.159253:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085868416:12345-0@lo:400:kworker.0 Request processed in 24us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684396.159265:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684396.159277:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684396.159282:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085868032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.159308:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085868032:12345-0@lo:400:kworker.0 Request processed in 26us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684396.159314:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684396.159323:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684396.159328:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085868160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.159356:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085868160:12345-0@lo:400:kworker.0 Request processed in 28us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684396.159361:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684396.159387:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684396.159393:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085868288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.159419:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085868288:12345-0@lo:400:kworker.0 Request processed in 26us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684396.159424:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788684396.159445:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684396.159449:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788684396.159476:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664859aa00 x1875571085868288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684396.159490:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085868288:0@lo:400:kworker.0 00010000:00080000:0.0:1788684396.159501:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664859b100 x1875571085868160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684396.159510:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085868160:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.159616:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085867136 00000100:00100000:2.0:1788684396.159620:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085867136 00000100:00100000:2.0:1788684396.159779:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085867648 00000100:00100000:2.0:1788684396.159792:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085867648 00000100:00100000:2.0:1788684396.159810:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085867264 00000100:00100000:2.0:1788684396.159812:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085867264 00000100:00100000:2.0:1788684396.159823:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085867776 00000100:00100000:2.0:1788684396.159825:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085867776 00000100:00100000:2.0:1788684396.159837:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684396.159843:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085867136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.159878:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085867136:12345-0@lo:400:kworker.0 Request processed in 35us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684396.159884:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684396.159895:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788684396.159900:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085867648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.159923:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085867648:12345-0@lo:400:kworker.0 Request processed in 23us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684396.159937:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788684396.159948:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684396.159953:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085867264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.159978:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085867264:12345-0@lo:400:kworker.0 Request processed in 25us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684396.159983:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684396.159992:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684396.159997:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085867776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.160019:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085867776:12345-0@lo:400:kworker.0 Request processed in 22us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684396.160024:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684396.160066:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085867008:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.160077:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085867520:0@lo:400:kworker.0 00010000:00080000:2.0:1788684396.160088:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648598380 x1875571085868032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684396.160097:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085868032:0@lo:400:kworker.0 00000100:00100000:2.0:1788684396.160107:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085866880:0@lo:400:kworker.0 00010000:00080000:2.0:1788684396.160116:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648599500 x1875571085867392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684396.160123:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085867392:0@lo:400:kworker.0 00010000:00080000:2.0:1788684396.160132:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664859bb80 x1875571085867904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684396.160151:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085867904:0@lo:400:kworker.0 00010000:00080000:2.0:1788684396.160164:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d664859a680 x1875571085868416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684396.160171:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085868416:0@lo:400:kworker.0 00000100:00100000:1.0:1788684396.161625:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085868544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684396.161810:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684396.161858:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085868544 00000100:00100000:1.0:1788684396.161864:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085868544 00000100:00100000:1.0:1788684396.161901:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788684396.161909:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085868544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684396.161933:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788684396.161970:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085868544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684396.161977:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788684396.162018:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085868544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684396.162123:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684396.162133:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085868672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684396.162161:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788684396.162551:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684396.162557:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684396.162578:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085867264:0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.162588:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085867776:0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.162598:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085867136:0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.162609:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085867648:0@lo:400:kworker.0 00000100:00100000:0.0:1788684396.162625:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684396.162630:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085868800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684396.162800:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085868672 00000100:00100000:1.0:1788684396.162806:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085868672 00000100:00100000:1.0:1788684396.162834:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788684396.162841:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085868672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788684396.162853:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788684396.163336:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085868672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 494us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684396.163352:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684396.163475:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684396.163834:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085868800 00000100:00100000:1.0:1788684396.163840:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085868800 00000100:00100000:1.0:1788684396.163879:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788684396.163886:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085868800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788684396.163907:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788684396.163952:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085868800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684396.163959:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788684396.163995:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085868800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684396.166177:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085868672:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788684396.286002:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788684396.292564:0:19847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1788684396.609869:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788684397.124461:0:19899:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684397.124734:0:19899:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788684397.319987:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788684397.980355:0:19949:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684397.980859:0:19949:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788684398.321395:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684398.321503:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073206400 00000100:00100000:3.0:1788684398.321512:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073206400 00000100:00100000:3.0:1788684398.321559:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 116 00000100:00100000:3.0:1788684398.321567:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2389:x1875571073206400:12345-192.168.206.44@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788684398.321595:0:17165:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 558e5e46-625a-47f1-bf34-9eb61f632413@192.168.206.44@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:3.0:1788684398.321622:0:17165:0:(genops.c:1385:class_connect()) connect: client 558e5e46-625a-47f1-bf34-9eb61f632413, cookie 0x44bac02bd54ad91e 00000100:00080000:3.0:1788684398.321764:0:17165:0:(import.c:65:import_set_state_nolock()) ffff8d67488fa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684398.321848:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+5:2389:x1875571073206400:12345-192.168.206.44@tcp:250:mount.lustre.0 Request processed in 279us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684398.321855:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 116 00010000:00010000:3.0:1788684398.334018:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684398.339088:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684398.339209:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073206528 00000100:00100000:2.0:1788684398.339224:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073206528 00000100:00100000:2.0:1788684398.339299:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 117 00000100:00100000:2.0:1788684398.339313:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+5:14894:x1875571073206528:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788684398.339335:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684398.339356:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4e00/0x44bac02bd54ad925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3e2e expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684398.339440:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4e00/0x44bac02bd54ad925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e2e expref: 6 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684398.339452:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4e00/0x44bac02bd54ad925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e2e expref: 6 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684398.339559:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4e00, rc 0) 00000100:00100000:2.0:1788684398.339642:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+6:14894:x1875571073206528:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 330us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.339650:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 117 00000100:00100000:0.0:1788684398.348530:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684398.348595:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073206656 00000100:00100000:3.0:1788684398.348605:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073206656 00000100:00100000:3.0:1788684398.348670:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:3.0:1788684398.348681:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+6:14894:x1875571073206656:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788684398.348827:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+6:14894:x1875571073206656:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 148us (378us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788684398.348836:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:1.0:1788684398.353975:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684398.354067:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073206784 00000100:00100000:3.0:1788684398.354077:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073206784 00000100:00100000:3.0:1788684398.354140:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:3.0:1788684398.354150:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+6:14894:x1875571073206784:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788684398.354165:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684398.354182:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a1a00/0x44bac02bd54ad92c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3e35 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684398.354209:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1a00/0x44bac02bd54ad92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e35 expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684398.354220:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a1a00/0x44bac02bd54ad92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e35 expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684398.354229:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1a00, rc 0) 00000100:00100000:3.0:1788684398.354294:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+7:14894:x1875571073206784:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684398.354302:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:1.0:1788684398.358079:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684398.358534:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073206912 00000100:00100000:2.0:1788684398.358543:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073206912 00000100:00100000:2.0:1788684398.358596:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:2.0:1788684398.358606:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+7:14894:x1875571073206912:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788684398.358763:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+8:14894:x1875571073206912:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 157us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.358770:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:2.0:1788684398.360664:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684398.360794:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073207040 00000100:00100000:0.0:1788684398.360801:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073207040 00000100:00100000:0.0:1788684398.360845:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:0.0:1788684398.360854:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fadb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+8:14894:x1875571073207040:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788684398.360984:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fadb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+8:14894:x1875571073207040:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 129us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684398.361001:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:1.0:1788684398.365257:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684398.365482:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073207168 00000100:00100000:3.0:1788684398.365491:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073207168 00000100:00100000:3.0:1788684398.365598:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:3.0:1788684398.365608:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+8:14912:x1875571073207168:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684398.365757:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+8:14912:x1875571073207168:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 150us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684398.365784:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:1.0:1788684398.397872:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684398.398149:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073207296 00000100:00100000:2.0:1788684398.398159:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073207296 00000100:00100000:2.0:1788684398.398216:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:2.0:1788684398.398226:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+8:14912:x1875571073207296:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684398.398400:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+8:14912:x1875571073207296:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 175us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.398413:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:2.0:1788684398.402518:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684398.402717:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073207424 00000100:00100000:3.0:1788684398.402726:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073207424 00000100:00100000:3.0:1788684398.402790:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:3.0:1788684398.402800:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+8:14912:x1875571073207424:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684398.402948:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+8:14912:x1875571073207424:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 149us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684398.402957:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:1.0:1788684398.408230:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684398.408920:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073207552 00000100:00100000:2.0:1788684398.408931:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073207552 00000100:00100000:2.0:1788684398.409000:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:2.0:1788684398.409011:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+8:14894:x1875571073207552:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788684398.409027:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684398.409043:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3e66 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684398.409087:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e66 expref: 9 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684398.409099:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e66 expref: 9 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684398.409107:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4400, rc 0) 00000100:00100000:2.0:1788684398.409167:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+9:14894:x1875571073207552:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 157us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.409173:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:1.0:1788684398.412272:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684398.412402:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073207680 00000100:00100000:3.0:1788684398.412411:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073207680 00000100:00100000:3.0:1788684398.412466:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:3.0:1788684398.412475:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fadb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+9:14894:x1875571073207680:12345-192.168.206.44@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788684398.412497:0:17164:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788684398.412524:0:17164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788684398.412528:0:17164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788684398.412531:0:17164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788684398.412534:0:17164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788684398.412536:0:17164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788684398.415398:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fadb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+9:14894:x1875571073207680:12345-192.168.206.44@tcp:256:mount.lustre.0 Request processed in 2892us (3101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.415412:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:1.0:1788684398.421820:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684398.422196:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073207808 00000100:00100000:0.0:1788684398.422209:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073207808 00000100:00100000:0.0:1788684398.422309:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:0.0:1788684398.422319:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+9:14894:x1875571073207808:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788684398.422336:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684398.422354:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3e6d expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684398.422423:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e6d expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684398.422434:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e6d expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684398.422443:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3fa00, rc 0) 00000100:00100000:0.0:1788684398.422507:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+10:14894:x1875571073207808:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 190us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684398.422516:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:1.0:1788684398.424872:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684398.424952:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073207936 00000100:00100000:3.0:1788684398.424961:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073207936 00000100:00100000:3.0:1788684398.425019:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:3.0:1788684398.425029:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+10:14894:x1875571073207936:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788684398.425304:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+10:14894:x1875571073207936:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 275us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684398.425313:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:3.0:1788684398.427573:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684398.427731:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073208064 00000100:00100000:2.0:1788684398.427739:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073208064 00000100:00100000:2.0:1788684398.427830:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:2.0:1788684398.427840:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+10:14894:x1875571073208064:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788684398.427980:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+10:14894:x1875571073208064:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.427999:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:1.0:1788684398.431030:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684398.431341:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073208192 00000100:00100000:0.0:1788684398.431350:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073208192 00000100:00100000:0.0:1788684398.431465:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:0.0:1788684398.431476:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+10:14916:x1875571073208192:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788684398.431617:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+10:14916:x1875571073208192:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 141us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684398.431625:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:1.0:1788684398.438466:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684398.438622:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073208320 00000100:00100000:2.0:1788684398.438631:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073208320 00000100:00100000:2.0:1788684398.438689:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:2.0:1788684398.438697:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+10:14916:x1875571073208320:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684398.438847:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+10:14916:x1875571073208320:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 149us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.438860:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:2.0:1788684398.452044:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684398.452315:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073208448 00000100:00100000:0.0:1788684398.452325:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073208448 00000100:00100000:0.0:1788684398.452748:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:0.0:1788684398.452758:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1875571073208448:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788684398.452798:0:17173:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c4cf9959-ce83-48ba-884e-11c1ebaf899c@192.168.206.44@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1788684398.452846:0:17173:0:(genops.c:1385:class_connect()) connect: client c4cf9959-ce83-48ba-884e-11c1ebaf899c, cookie 0x44bac02bd54ad941 00000004:00100000:0.0:1788684398.452874:0:17173:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788684398.453070:0:17173:0:(import.c:65:import_set_state_nolock()) ffff8d677cb89800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684398.453153:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:2389:x1875571073208448:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 395us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684398.455750:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:1.0:1788684398.460721:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684398.461581:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073208704 00000100:00100000:0.0:1788684398.461592:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073208704 00000100:00100000:0.0:1788684398.461645:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:0.0:1788684398.461653:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2389:x1875571073208704:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788684398.461684:0:18403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c4cf9959-ce83-48ba-884e-11c1ebaf899c@192.168.206.44@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1788684398.461732:0:18403:0:(genops.c:1385:class_connect()) connect: client c4cf9959-ce83-48ba-884e-11c1ebaf899c, cookie 0x44bac02bd54ad948 00000004:00100000:0.0:1788684398.461756:0:18403:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788684398.461917:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684398.461952:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00080000:0.0:1788684398.461964:0:18403:0:(import.c:65:import_set_state_nolock()) ffff8d677cb8e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684398.461987:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073208960 00000100:00100000:3.0:1788684398.461991:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073208960 00000100:00100000:3.0:1788684398.462020:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073208576 00000100:00100000:0.0:1788684398.462021:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:2389:x1875571073208704:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 367us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684398.462023:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073208576 00000100:00100000:0.0:1788684398.462029:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1788684398.462035:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:3.0:1788684398.462041:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:14894:x1875571073208960:12345-192.168.206.44@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788684398.462044:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:0.0:1788684398.462049:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:0:x1875571073208576:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788684398.462074:0:17173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000004:00000024:0.0:1788684398.462077:0:18403:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788684398.462235:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:0:x1875571073208576:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 184us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684398.462242:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00080000:0.0:1788684398.462262:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684398.462546:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14894:x1875571073208960:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 503us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.462554:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:1.0:1788684398.465706:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684398.465853:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073209088 00000100:00100000:2.0:1788684398.465862:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073209088 00000100:00100000:2.0:1788684398.465918:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:2.0:1788684398.465927:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14894:x1875571073209088:12345-192.168.206.44@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788684398.466937:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14894:x1875571073209088:12345-192.168.206.44@tcp:40:mount.lustre.0 Request processed in 1004us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.466948:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:2.0:1788684398.469493:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684398.469565:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073208832 00000100:00100000:0.0:1788684398.469573:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073208832 00000100:00100000:0.0:1788684398.469650:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:0.0:1788684398.469660:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:0:x1875571073208832:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788684398.469711:0:17173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788684398.469798:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:0:x1875571073208832:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 139us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684398.469806:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00080000:3.0:1788684398.469916:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684398.473728:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684398.473764:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684398.473811:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684398.473940:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073209216 00000100:00100000:3.0:1788684398.473950:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073209216 00000100:00100000:3.0:1788684398.473998:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073209344 00000100:00100000:3.0:1788684398.474001:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073209344 00000100:00100000:3.0:1788684398.474020:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1788684398.474027:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875571073209216:12345-192.168.206.44@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788684398.474146:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073209472 00000100:00100000:1.0:1788684398.474162:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073209472 00000100:00100000:1.0:1788684398.474194:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:1.0:1788684398.474200:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14894:x1875571073209472:12345-192.168.206.44@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788684398.474264:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14894:x1875571073209472:12345-192.168.206.44@tcp:900:mount.lustre.0 Request processed in 64us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684398.474272:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:2.0:1788684398.474719:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:2.0:1788684398.474725:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1875571073209344:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788684398.474746:0:19567:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c4cf9959-ce83-48ba-884e-11c1ebaf899c@192.168.206.44@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:2.0:1788684398.474786:0:19567:0:(genops.c:1385:class_connect()) connect: client c4cf9959-ce83-48ba-884e-11c1ebaf899c, cookie 0x44bac02bd54ad94f 00002000:00100000:2.0:1788684398.474798:0:19567:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c4cf9959-ce83-48ba-884e-11c1ebaf899c/ffff8d6646588000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788684398.474816:0:19567:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788684398.474980:0:19567:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788684398.475006:0:19567:0:(import.c:65:import_set_state_nolock()) ffff8d664658d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684398.475053:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:2389:x1875571073209344:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 326us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684398.475074:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00010000:00080000:3.0:1788684398.475844:0:18679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c4cf9959-ce83-48ba-884e-11c1ebaf899c@192.168.206.44@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:3.0:1788684398.475874:0:18679:0:(genops.c:1385:class_connect()) connect: client c4cf9959-ce83-48ba-884e-11c1ebaf899c, cookie 0x44bac02bd54ad956 00002000:00100000:3.0:1788684398.475882:0:18679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c4cf9959-ce83-48ba-884e-11c1ebaf899c/ffff8d664844f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788684398.475897:0:18679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788684398.476460:0:18679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788684398.476488:0:18679:0:(import.c:65:import_set_state_nolock()) ffff8d66459a8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684398.476586:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:2389:x1875571073209216:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 2557us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684398.476594:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:2.0:1788684398.477947:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684398.478191:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073209600 00000100:00100000:1.0:1788684398.478200:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073209600 00000100:00100000:1.0:1788684398.478286:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1788684398.478296:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14894:x1875571073209600:12345-192.168.206.44@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788684398.481751:0:17174:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3337us 00000004:00200000:3.0:1788684398.497216:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788684398.497328:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14894:x1875571073209600:12345-192.168.206.44@tcp:33:mount.lustre.0 Request processed in 19029us (19385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684398.497343:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1788684398.694289:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684398.694623:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073209728 00000100:00100000:0.0:1788684398.694762:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073209728 00000100:00100000:0.0:1788684398.694846:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:0.0:1788684398.694862:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14939:x1875571073209728:12345-192.168.206.44@tcp:101:mkdir.0 00010000:00010000:0.0:1788684398.694888:0:18403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684398.694922:0:18403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e400/0x44bac02bd54ad95d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3e9e expref: -99 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684398.700050:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fc00/0x44bac02bd54ad964 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684398.700081:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fc00/0x44bac02bd54ad964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684398.700103:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fc00/0x44bac02bd54ad964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684398.700174:0:18403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788684398.700179:0:18403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684398.700271:0:18403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fc00/0x44bac02bd54ad964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684398.700314:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e400/0x44bac02bd54ad95d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e9e expref: 8 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684398.700577:0:18403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fc00/0x44bac02bd54ad964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e9e expref: 7 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684398.700589:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f70b00) 00010000:00010000:0.0:1788684398.700592:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684398.700597:0:18403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3fc00, rc 0) 00000100:00100000:0.0:1788684398.700699:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:14939:x1875571073209728:12345-192.168.206.44@tcp:101:mkdir.0 Request processed in 5841us (6422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684398.700779:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:3.0:1788684399.230936:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684399.230966:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085868928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684399.231062:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684399.231689:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085868928 00000100:00100000:0.0:1788684399.231700:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085868928 00000100:00100000:0.0:1788684399.231787:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788684399.231808:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085868928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684399.231850:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788684399.231931:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085868928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684399.231938:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788684399.231967:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684399.231986:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085869056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684399.232016:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085868928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684399.232054:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684399.232097:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085869056 00000100:00100000:0.0:1788684399.232104:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085869056 00000100:00100000:0.0:1788684399.232153:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788684399.232161:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085869056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788684399.232187:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788684399.232243:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085869056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684399.232257:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684399.232270:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085869184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684399.232276:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684399.232336:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684399.232532:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085869056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684399.233803:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085869184 00000100:00100000:0.0:1788684399.233812:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085869184 00000100:00100000:0.0:1788684399.233882:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684399.233892:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085869184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684399.233913:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788684399.233984:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085869184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684399.233990:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788684399.234100:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684399.234215:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085869184:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788684399.358457:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788684400.126229:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788684400.382574:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684400.658684:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684400.658955:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073209856 00000100:00100000:2.0:1788684400.658964:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073209856 00000100:00100000:2.0:1788684400.659050:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:2.0:1788684400.659060:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:14992:x1875571073209856:12345-192.168.206.44@tcp:41:lfs.0 00000004:00000024:2.0:1788684400.659117:0:17171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788684400.659217:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:14992:x1875571073209856:12345-192.168.206.44@tcp:41:lfs.0 Request processed in 157us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684400.659225:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00080000:3.0:1788684400.660263:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684400.671152:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684400.671314:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073209984 00000100:00100000:3.0:1788684400.671324:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073209984 00000100:00100000:3.0:1788684400.671489:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:3.0:1788684400.671511:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14992:x1875571073209984:12345-192.168.206.44@tcp:41:lfs.0 00000004:00000024:3.0:1788684400.671548:0:17172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788684400.671648:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14992:x1875571073209984:12345-192.168.206.44@tcp:41:lfs.0 Request processed in 150us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684400.671655:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00080000:0.0:1788684400.671711:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788684400.675936:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684400.676050:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073210112 00000100:00100000:0.0:1788684400.676059:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073210112 00000100:00100000:0.0:1788684400.676136:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:0.0:1788684400.676147:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14992:x1875571073210112:12345-192.168.206.44@tcp:13:lfs.0 00002000:00000024:0.0:1788684400.676191:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788684400.676278:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14992:x1875571073210112:12345-192.168.206.44@tcp:13:lfs.0 Request processed in 131us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684400.676285:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00080000:3.0:1788684400.676679:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684400.683422:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684400.683588:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073210240 00000100:00100000:0.0:1788684400.683598:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073210240 00000100:00100000:0.0:1788684400.683799:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:0.0:1788684400.683810:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14992:x1875571073210240:12345-192.168.206.44@tcp:13:lfs.0 00002000:00000024:0.0:1788684400.683865:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788684400.683972:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:14992:x1875571073210240:12345-192.168.206.44@tcp:13:lfs.0 Request processed in 164us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684400.683980:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00080000:3.0:1788684400.686223:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684400.899726:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684400.899848:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073210368 00000100:00100000:0.0:1788684400.899858:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073210368 00000100:00100000:0.0:1788684400.899912:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:0.0:1788684400.899922:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+10:15027:x1875571073210368:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788684400.899938:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684400.899956:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3e400/0x44bac02bd54ad96b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ea5 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684400.899985:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3e400/0x44bac02bd54ad96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ea5 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684400.899999:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3e400/0x44bac02bd54ad96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ea5 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684400.900008:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3e400, rc 0) 00000100:00100000:0.0:1788684400.900070:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+11:15027:x1875571073210368:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 149us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684400.900078:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:2.0:1788684400.909772:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684400.909955:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073210496 00000100:00100000:3.0:1788684400.909965:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073210496 00000100:00100000:3.0:1788684400.910027:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:3.0:1788684400.910039:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+11:15027:x1875571073210496:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788684400.910215:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+11:15027:x1875571073210496:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 177us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684400.910224:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:1.0:1788684400.916240:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684400.916355:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073210624 00000100:00100000:2.0:1788684400.916386:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073210624 00000100:00100000:2.0:1788684400.916478:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:2.0:1788684400.916488:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+11:15027:x1875571073210624:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788684400.916874:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+11:15027:x1875571073210624:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 386us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684400.916883:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:2.0:1788684400.921359:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684400.921611:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073210752 00000100:00100000:0.0:1788684400.921621:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073210752 00000100:00100000:0.0:1788684400.921678:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 135 00000100:00100000:0.0:1788684400.921687:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+11:15031:x1875571073210752:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788684400.921859:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+11:15031:x1875571073210752:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 172us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684400.921869:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 135 00000100:00100000:1.0:1788684400.943839:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684400.944004:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073210880 00000100:00100000:2.0:1788684400.944016:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073210880 00000100:00100000:2.0:1788684400.944086:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 136 00000100:00100000:2.0:1788684400.944098:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+11:15031:x1875571073210880:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684400.944275:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+11:15031:x1875571073210880:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 179us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684400.944282:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 136 00000100:00100000:1.0:1788684400.956599:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684400.956968:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073211008 00000100:00100000:3.0:1788684400.956979:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073211008 00000100:00100000:3.0:1788684400.957047:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:3.0:1788684400.957059:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+11:15031:x1875571073211008:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684400.957237:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+11:15031:x1875571073211008:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 179us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684400.957247:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:3.0:1788684400.962418:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684400.962511:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073211136 00000100:00100000:0.0:1788684400.962521:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073211136 00000100:00100000:0.0:1788684400.962584:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:0.0:1788684400.962593:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+11:15027:x1875571073211136:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788684400.962609:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684400.962625:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3ea00/0x44bac02bd54ad972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ed6 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684400.962662:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3ea00/0x44bac02bd54ad972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ed6 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684400.962674:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3ea00/0x44bac02bd54ad972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ed6 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684400.962683:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3ea00, rc 0) 00000100:00100000:0.0:1788684400.962734:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+12:15027:x1875571073211136:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 140us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684400.962752:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:1.0:1788684400.967827:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684400.967888:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073211264 00000100:00100000:2.0:1788684400.967898:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073211264 00000100:00100000:2.0:1788684400.967947:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00100000:2.0:1788684400.967956:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+12:15027:x1875571073211264:12345-192.168.206.44@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788684400.968077:0:17163:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788684400.968099:0:17163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788684400.968103:0:17163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788684400.968105:0:17163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788684400.968108:0:17163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788684400.968110:0:17163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788684400.971483:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+12:15027:x1875571073211264:12345-192.168.206.44@tcp:256:mount.lustre.0 Request processed in 3517us (3748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684400.971507:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00100000:1.0:1788684400.976542:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684400.976630:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073211392 00000100:00100000:3.0:1788684400.976639:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073211392 00000100:00100000:3.0:1788684400.976699:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:3.0:1788684400.976709:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+12:15027:x1875571073211392:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788684400.976725:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684400.976741:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3edd expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684400.976777:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3edd expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684400.976789:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3edd expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684400.976812:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0c00, rc 0) 00000100:00100000:3.0:1788684400.976872:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+13:15027:x1875571073211392:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 164us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684400.976879:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:2.0:1788684400.979711:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684400.979958:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073211520 00000100:00100000:3.0:1788684400.979968:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073211520 00000100:00100000:3.0:1788684400.980024:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:3.0:1788684400.980033:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:15027:x1875571073211520:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788684400.980829:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:15027:x1875571073211520:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 791us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684400.980841:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:1.0:1788684400.990483:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684400.990560:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073211648 00000100:00100000:0.0:1788684400.990569:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073211648 00000100:00100000:0.0:1788684400.990625:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:0.0:1788684400.990645:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+13:15027:x1875571073211648:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788684400.990800:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+13:15027:x1875571073211648:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 165us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684400.990809:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:0.0:1788684400.994926:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684401.001731:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073211776 00000100:00100000:3.0:1788684401.001747:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073211776 00000100:00100000:2.0:1788684401.003125:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:2.0:1788684401.003141:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:15036:x1875571073211776:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684401.003410:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:15036:x1875571073211776:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 272us (8492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.003426:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:3.0:1788684401.008704:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684401.010097:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073211904 00000100:00100000:2.0:1788684401.010111:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073211904 00000100:00100000:2.0:1788684401.010241:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:2.0:1788684401.010253:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+13:15036:x1875571073211904:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684401.010459:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+13:15036:x1875571073211904:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 207us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.010466:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:1.0:1788684401.015997:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684401.016543:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684401.020678:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073212032 00000100:00100000:0.0:1788684401.020694:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073212032 00000100:00100000:0.0:1788684401.020780:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073212288 00000100:00100000:0.0:1788684401.020797:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073212288 00000100:00100000:0.0:1788684401.020832:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1788684401.020842:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1875571073212032:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788684401.020879:0:17173:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 55cddeac-d533-48cb-9ea5-95cbce9430eb@192.168.206.44@tcp t0 exp 0000000000000000 cur 482 last 0 00000100:00100000:3.0:1788684401.020881:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1788684401.020902:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875571073212288:12345-192.168.206.44@tcp:38:mount.lustre.0 00000020:00000080:0.0:1788684401.020932:0:17173:0:(genops.c:1385:class_connect()) connect: client 55cddeac-d533-48cb-9ea5-95cbce9430eb, cookie 0x44bac02bd54ad980 00010000:00080000:3.0:1788684401.020944:0:17172:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 55cddeac-d533-48cb-9ea5-95cbce9430eb@192.168.206.44@tcp t0 exp 0000000000000000 cur 482 last 0 00000004:00100000:0.0:1788684401.020964:0:17173:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1788684401.021009:0:17172:0:(genops.c:1385:class_connect()) connect: client 55cddeac-d533-48cb-9ea5-95cbce9430eb, cookie 0x44bac02bd54ad987 00000004:00100000:3.0:1788684401.021037:0:17172:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788684401.021119:0:17173:0:(import.c:65:import_set_state_nolock()) ffff8d6746dad800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788684401.021209:0:17172:0:(import.c:65:import_set_state_nolock()) ffff8d677cbfa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684401.021211:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2389:x1875571073212032:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 366us (5232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684401.021225:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:3.0:1788684401.021300:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2389:x1875571073212288:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 398us (4756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.021311:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684401.026597:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684401.026656:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684401.026691:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684401.026833:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073212160 00000100:00100000:3.0:1788684401.026847:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073212160 00000100:00100000:3.0:1788684401.026933:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073212416 00000100:00100000:3.0:1788684401.026936:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073212416 00000100:00100000:3.0:1788684401.026997:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073212544 00000100:00100000:3.0:1788684401.027001:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073212544 00000100:00100000:3.0:1788684401.027019:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1788684401.027029:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+7:0:x1875571073212160:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788684401.027080:0:17172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788684401.027163:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+7:0:x1875571073212160:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 135us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.027172:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1788684401.027192:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1788684401.027198:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:0:x1875571073212416:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788684401.027218:0:17172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788684401.027250:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:0:x1875571073212416:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 52us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.027256:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1788684401.027268:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:3.0:1788684401.027275:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15027:x1875571073212544:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788684401.027286:0:17172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788684401.027309:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15027:x1875571073212544:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 35us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.027315:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00080000:1.0:1788684401.027859:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684401.027865:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684401.032507:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684401.033209:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073212672 00000100:00100000:3.0:1788684401.033224:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073212672 00000100:00100000:3.0:1788684401.033404:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:3.0:1788684401.033416:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15027:x1875571073212672:12345-192.168.206.44@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788684401.033543:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15027:x1875571073212672:12345-192.168.206.44@tcp:40:mount.lustre.0 Request processed in 128us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.033551:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:3.0:1788684401.036041:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684401.036300:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073212800 00000100:00100000:2.0:1788684401.036312:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073212800 00000100:00100000:2.0:1788684401.036424:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1788684401.036434:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875571073212800:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788684401.036485:0:19204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 55cddeac-d533-48cb-9ea5-95cbce9430eb@192.168.206.44@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1788684401.036525:0:19204:0:(genops.c:1385:class_connect()) connect: client 55cddeac-d533-48cb-9ea5-95cbce9430eb, cookie 0x44bac02bd54ad98e 00002000:00100000:2.0:1788684401.036540:0:19204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 55cddeac-d533-48cb-9ea5-95cbce9430eb/ffff8d664658f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788684401.036553:0:19204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788684401.036658:0:19204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788684401.036699:0:19204:0:(import.c:65:import_set_state_nolock()) ffff8d664658e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684401.036778:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684401.036788:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2389:x1875571073212800:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 353us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.036798:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1788684401.036816:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073212928 00000100:00100000:2.0:1788684401.036821:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073212928 00000100:00100000:2.0:1788684401.036845:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:2.0:1788684401.036851:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875571073212928:12345-192.168.206.44@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788684401.036876:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00010000:00080000:2.0:1788684401.036889:0:19204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 55cddeac-d533-48cb-9ea5-95cbce9430eb@192.168.206.44@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1788684401.036911:0:19204:0:(genops.c:1385:class_connect()) connect: client 55cddeac-d533-48cb-9ea5-95cbce9430eb, cookie 0x44bac02bd54ad995 00002000:00100000:2.0:1788684401.036916:0:19204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 55cddeac-d533-48cb-9ea5-95cbce9430eb/ffff8d664658a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788684401.036924:0:19204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788684401.036967:0:19204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788684401.036998:0:19204:0:(import.c:65:import_set_state_nolock()) ffff8d664658d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684401.037030:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2389:x1875571073212928:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 177us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.037037:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1788684401.037887:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073213056 00000100:00100000:1.0:1788684401.037899:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073213056 00000100:00100000:1.0:1788684401.037977:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:1.0:1788684401.037988:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15027:x1875571073213056:12345-192.168.206.44@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788684401.038066:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15027:x1875571073213056:12345-192.168.206.44@tcp:900:mount.lustre.0 Request processed in 80us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684401.038073:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:3.0:1788684401.045439:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684401.046319:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073213184 00000100:00100000:2.0:1788684401.046337:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073213184 00000100:00100000:2.0:1788684401.046781:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:2.0:1788684401.046795:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15027:x1875571073213184:12345-192.168.206.44@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788684401.046920:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788684401.047042:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15027:x1875571073213184:12345-192.168.206.44@tcp:33:mount.lustre.0 Request processed in 250us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.047050:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:1.0:1788684401.228177:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684401.228456:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073213312 00000100:00100000:2.0:1788684401.228471:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073213312 00000100:00100000:2.0:1788684401.228548:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1788684401.228561:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15059:x1875571073213312:12345-192.168.206.44@tcp:101:mkdir.0 00010000:00010000:2.0:1788684401.228587:0:18403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684401.228616:0:18403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad99c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f0e expref: -99 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684401.228731:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684401.228748:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684401.228772:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684401.228823:0:18403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788684401.228826:0:18403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684401.228850:0:18403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684401.228892:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ad99c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f0e expref: 8 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684401.228915:0:18403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f0e expref: 7 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684401.228924:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f70b00) 00010000:00010000:2.0:1788684401.228927:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684401.228932:0:18403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4600, rc 0) 00000100:00100000:2.0:1788684401.229009:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+7:15059:x1875571073213312:12345-192.168.206.44@tcp:101:mkdir.0 Request processed in 450us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.229017:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:3.0:1788684401.277870:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085869440:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.277971:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684401.278068:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085869952:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.278094:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684401.278126:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085870464:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.278158:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684401.278185:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788684401.278192:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085869568:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.278218:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684401.278239:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085870080:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.278264:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684401.278284:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085870592:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.278311:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684401.278346:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085869568 00000100:00100000:3.0:1788684401.278355:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085869568 00000100:00100000:3.0:1788684401.278453:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085870080 00000100:00100000:3.0:1788684401.278464:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085870080 00000100:00100000:3.0:1788684401.278494:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788684401.278504:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085869568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.278713:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085869440 00000100:00100000:0.0:1788684401.278717:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085869440 00000100:00100000:0.0:1788684401.278747:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085869952 00000100:00100000:0.0:1788684401.278750:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085869952 00000100:00100000:0.0:1788684401.278780:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788684401.278787:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085869440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.278851:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085869440:12345-0@lo:400:kworker.0 Request processed in 64us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684401.278859:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788684401.278878:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788684401.278884:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085869952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.278915:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085869952:12345-0@lo:400:kworker.0 Request processed in 31us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684401.278921:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788684401.278943:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085869312:0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.278989:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684401.279017:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085869824:0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.279042:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684401.279061:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085870336:0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.279084:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684401.279103:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085870848:0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.279187:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684401.279202:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788684401.279209:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085869696:0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.279233:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684401.279308:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085870208:0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.279334:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684401.279345:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085870720:0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.279407:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684401.279443:0:19567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085869696 00000100:00100000:0.0:1788684401.279447:0:19567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085869696 00000100:00100000:0.0:1788684401.279469:0:19567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085870208 00000100:00100000:0.0:1788684401.279472:0:19567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085870208 00000100:00100000:0.0:1788684401.279484:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684401.279490:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085870080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.279649:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085869568:12345-0@lo:400:kworker.0 Request processed in 1144us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.279658:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788684401.279673:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684401.279680:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085869696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.279718:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085869696:12345-0@lo:400:kworker.0 Request processed in 39us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.279724:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684401.279736:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684401.279743:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085870208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.279781:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085870208:12345-0@lo:400:kworker.0 Request processed in 39us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.279787:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684401.279833:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085869696:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.279843:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085870208:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.279873:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085870464 00000100:00100000:3.0:1788684401.279877:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085870464 00000100:00100000:3.0:1788684401.279902:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085870592 00000100:00100000:3.0:1788684401.279905:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085870592 00000100:00100000:3.0:1788684401.279917:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085869824 00000100:00100000:3.0:1788684401.279920:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085869824 00000100:00100000:3.0:1788684401.279929:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085870336 00000100:00100000:3.0:1788684401.279932:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085870336 00000100:00100000:3.0:1788684401.279942:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085870848 00000100:00100000:3.0:1788684401.279955:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085870848 00000100:00100000:3.0:1788684401.279972:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085870720 00000100:00100000:3.0:1788684401.279974:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085870720 00000100:00100000:3.0:1788684401.279989:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788684401.279995:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085870464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.280045:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085870464:12345-0@lo:400:kworker.0 Request processed in 50us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.280052:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788684401.280064:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788684401.280071:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085870592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.280098:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085870592:12345-0@lo:400:kworker.0 Request processed in 28us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684401.280103:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684401.280282:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788684401.280291:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085869824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684401.280336:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085869824:12345-0@lo:400:kworker.0 Request processed in 47us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.280341:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788684401.280352:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788684401.280357:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085870336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684401.280394:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085870336:12345-0@lo:400:kworker.0 Request processed in 37us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.280399:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788684401.280408:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684401.280414:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085870848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684401.280436:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085870848:12345-0@lo:400:kworker.0 Request processed in 23us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.280442:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684401.280450:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788684401.280455:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085870720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684401.280476:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085870720:12345-0@lo:400:kworker.0 Request processed in 21us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.280481:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788684401.280600:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085870080:12345-0@lo:400:kworker.0 Request processed in 1107us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684401.280651:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684401.280673:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684401.280686:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085870976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684401.280725:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684401.280785:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085870976 00000100:00100000:0.0:1788684401.280789:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085870976 00000100:00100000:0.0:1788684401.280821:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684401.280828:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085870976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684401.280845:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788684401.280884:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085870976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684401.280891:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684401.280930:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085870976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684401.280961:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085869312 00000100:00100000:0.0:1788684401.280965:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085869312 00000100:00100000:0.0:1788684401.280991:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788684401.280997:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:3624:x1875571085869312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684401.281029:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:3624:x1875571085869312:12345-0@lo:400:kworker.0 Request processed in 32us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684401.281035:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1788684401.282798:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684401.282812:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684401.282816:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684401.282820:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684401.282894:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085871104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684401.282896:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085871232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684401.284174:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085870720:0@lo:400:kworker.0 00000100:00100000:2.0:1788684401.284194:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085869312:0@lo:400:kworker.0 00000100:00100000:2.0:1788684401.284208:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085869824:0@lo:400:kworker.0 00000100:00100000:2.0:1788684401.284221:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085870336:0@lo:400:kworker.0 00010000:00080000:2.0:1788684401.284239:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677709b480 x1875571085870848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684401.284274:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085870848:0@lo:400:kworker.0 00000100:00100000:1.0:1788684401.284330:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684401.284426:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085871104 00000100:00100000:2.0:1788684401.284434:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085871104 00000100:00100000:2.0:1788684401.284501:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788684401.284513:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085871104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684401.284650:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684401.284712:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085871104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 201us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.284721:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788684401.284864:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085871104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684401.285024:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684401.285109:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085871232 00000100:00100000:2.0:1788684401.285243:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085871232 00000100:00100000:2.0:1788684401.285276:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788684401.285282:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085871232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684401.285297:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788684401.285341:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085871232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684401.285348:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684401.285423:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085871232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684401.285614:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085869568:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.285630:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085870080:0@lo:400:kworker.0 00010000:00080000:3.0:1788684401.285647:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677709bb80 x1875571085870592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684401.285659:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085870592:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.285675:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085869440:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.285689:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085869952:0@lo:400:kworker.0 00000100:00100000:3.0:1788684401.285704:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085870464:0@lo:400:kworker.0 00010000:00010000:3.0:1788684401.406173:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684402.429949:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684403.454531:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788684403.848987:0:17903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55cddeac-d533-48cb-9ea5-95cbce9430eb 00000001:00100000:1.0:1788684403.849001:0:17903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000001:00100000:3.0:1788684403.849064:0:19491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55cddeac-d533-48cb-9ea5-95cbce9430eb 00000001:00100000:3.0:1788684403.849073:0:19491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000001:00100000:1.0:1788684403.849691:0:18674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55cddeac-d533-48cb-9ea5-95cbce9430eb 00000001:00100000:1.0:1788684403.849698:0:18674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000001:00100000:1.0:1788684403.853261:0:17151:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55cddeac-d533-48cb-9ea5-95cbce9430eb 00000001:00100000:1.0:1788684403.853279:0:17151:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000001:02000400:1.0:1788684403.958969:0:20047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788684404.349778:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684404.349801:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085871360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684404.349927:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684404.349988:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085871360 00000100:00100000:0.0:1788684404.349995:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085871360 00000100:00100000:0.0:1788684404.350044:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788684404.350053:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085871360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684404.350090:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788684404.350138:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085871360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684404.350146:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788684404.350203:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085871360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684404.350409:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085871488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684404.350442:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684404.351129:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684404.351141:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085871616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684404.351192:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684404.351329:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085871616 00000100:00100000:3.0:1788684404.351336:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085871616 00000100:00100000:3.0:1788684404.351411:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788684404.351421:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085871616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684404.351450:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684404.351496:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085871616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684404.351503:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788684404.351545:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085871616:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788684404.351954:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684404.352008:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085871488 00000100:00100000:0.0:1788684404.352014:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085871488 00000100:00100000:0.0:1788684404.352053:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788684404.352061:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085871488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788684404.352084:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788684404.352135:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085871488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684404.352142:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788684404.352311:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085871488:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788684404.479249:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684405.505859:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684406.397810:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085871744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684406.397877:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.397965:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085871744 00000100:00100000:0.0:1788684406.397972:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085871744 00000100:00100000:0.0:1788684406.398024:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684406.398033:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085871744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684406.398060:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788684406.398104:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085871744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.398122:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684406.398171:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085871744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684406.398353:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085871872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684406.398406:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684406.398435:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684406.398444:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085871872 00000100:00100000:2.0:1788684406.398453:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085871872 00000100:00100000:2.0:1788684406.398483:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788684406.398489:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085871872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684406.398499:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788684406.398528:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085871872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684406.398535:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788684406.398550:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684406.398571:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085871872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684406.399054:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085872000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684406.399084:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684406.399171:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085872000 00000100:00100000:2.0:1788684406.399175:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085872000 00000100:00100000:2.0:1788684406.399206:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684406.399212:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085872000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684406.399232:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684406.399264:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085872000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684406.399270:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788684406.399285:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684406.399306:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085872000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684406.406919:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085872384:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407005:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407038:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085872896:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407061:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407087:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788684406.407093:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085872256:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407117:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407145:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085872768:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407165:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407181:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085873280:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407199:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407226:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085872384 00000100:00100000:0.0:1788684406.407233:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085872384 00000100:00100000:0.0:1788684406.407269:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085872896 00000100:00100000:0.0:1788684406.407271:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085872896 00000100:00100000:0.0:1788684406.407293:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085872768 00000100:00100000:0.0:1788684406.407296:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085872768 00000100:00100000:0.0:1788684406.407305:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085873280 00000100:00100000:0.0:1788684406.407308:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085873280 00000100:00100000:0.0:1788684406.407322:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788684406.407330:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085872384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407419:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085872384:12345-0@lo:400:kworker.0 Request processed in 88us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.407426:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788684406.407457:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788684406.407464:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085872896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407492:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085872896:12345-0@lo:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.407498:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788684406.407508:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788684406.407512:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085872768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407534:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085872768:12345-0@lo:400:kworker.0 Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.407540:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788684406.407550:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788684406.407555:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085873280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407580:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085873280:12345-0@lo:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.407585:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788684406.407618:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085872256 00000100:00100000:0.0:1788684406.407622:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085872256 00000100:00100000:0.0:1788684406.407647:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684406.407652:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085872256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407686:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085872256:12345-0@lo:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.407691:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788684406.407723:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684406.407727:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684406.407750:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085872512:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407774:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407799:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085873024:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407822:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407839:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788684406.407844:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085872128:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407866:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407885:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085872640:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407903:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407917:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085873152:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.407932:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684406.407950:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085872512 00000100:00100000:0.0:1788684406.407953:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085872512 00000100:00100000:0.0:1788684406.407973:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788684406.407977:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085872512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408004:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085872512:12345-0@lo:400:kworker.0 Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.408010:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788684406.408023:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085872128 00000100:00100000:0.0:1788684406.408026:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085872128 00000100:00100000:0.0:1788684406.408044:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788684406.408049:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:3625:x1875571085872128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408071:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:3625:x1875571085872128:12345-0@lo:400:kworker.0 Request processed in 22us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.408076:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788684406.408099:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085873024 00000100:00100000:0.0:1788684406.408102:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085873024 00000100:00100000:0.0:1788684406.408121:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085873152 00000100:00100000:0.0:1788684406.408124:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085873152 00000100:00100000:0.0:1788684406.408149:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788684406.408153:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085873024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408180:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085873024:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.408186:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788684406.408197:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684406.408203:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085873152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408243:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085873152:12345-0@lo:400:kworker.0 Request processed in 40us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.408250:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788684406.408267:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684406.408270:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684406.408295:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085872128:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408306:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085873152:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408314:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085872512:0@lo:400:kworker.0 00010000:00080000:0.0:1788684406.408325:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648666a00 x1875571085873024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684406.408334:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085873024:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408388:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085872256:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408399:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085872768:0@lo:400:kworker.0 00010000:00080000:0.0:1788684406.408409:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648665880 x1875571085873280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684406.408417:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085873280:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408434:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085872384:0@lo:400:kworker.0 00000100:00100000:0.0:1788684406.408445:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085872896:0@lo:400:kworker.0 00000100:00100000:3.0:1788684406.411110:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085872640 00000100:00100000:3.0:1788684406.411124:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085872640 00000100:00100000:3.0:1788684406.411203:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684406.411212:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085872640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684406.411296:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085872640:12345-0@lo:400:kworker.0 Request processed in 85us (3391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684406.411303:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684406.411352:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085872640:0@lo:400:kworker.0 00000100:00080000:2.0:1788684406.411448:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684406.461235:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684406.461268:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684406.461288:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684406.461309:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684406.461323:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684406.461337:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684406.461351:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684406.461380:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684406.461402:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684406.461428:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073213440 00000100:00100000:0.0:1788684406.461436:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073213440 00000100:00100000:0.0:1788684406.461480:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 147 00000100:00100000:0.0:1788684406.461489:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:2393:x1875571073213440:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684406.461492:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073213952 00000100:00100000:3.0:1788684406.461496:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073213952 00000100:00100000:3.0:1788684406.461528:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073214464 00000100:00100000:3.0:1788684406.461531:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073214464 00000100:00100000:3.0:1788684406.461542:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073213824 00000100:00100000:3.0:1788684406.461544:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073213824 00000100:00100000:0.0:1788684406.461553:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:2393:x1875571073213440:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 66us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.461561:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 147 00000100:00100000:3.0:1788684406.461565:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073214336 00000100:00100000:3.0:1788684406.461568:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073214336 00000100:00100000:3.0:1788684406.461579:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:3.0:1788684406.461586:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073213952:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684406.461591:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073213696 00000100:00100000:3.0:1788684406.461613:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073213952:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684406.461620:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:3.0:1788684406.461631:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:3.0:1788684406.461637:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073214464:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684406.461660:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073214464:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684406.461666:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:3.0:1788684406.461676:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:3.0:1788684406.461682:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073213824:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684406.461703:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073213824:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684406.461709:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:3.0:1788684406.461718:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:3.0:1788684406.461724:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073214336:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684406.461759:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073214336:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 35us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684406.461764:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00080000:3.0:1788684406.461779:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684406.461783:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684406.464319:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073213696 00000100:00100000:0.0:1788684406.464423:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073214208 00000100:00100000:0.0:1788684406.464431:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073214208 00000100:00100000:0.0:1788684406.464446:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073213568 00000100:00100000:0.0:1788684406.464448:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073213568 00000100:00100000:0.0:1788684406.464460:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073214080 00000100:00100000:0.0:1788684406.464462:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073214080 00000100:00100000:0.0:1788684406.464481:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:0.0:1788684406.464504:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073213696:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684406.464571:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073213696:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 70us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.464578:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:0.0:1788684406.464611:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:0.0:1788684406.464619:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073214208:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684406.464644:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073214208:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.464650:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:0.0:1788684406.464662:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:0.0:1788684406.464668:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:2393:x1875571073213568:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684406.464689:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:2393:x1875571073213568:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (3351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.464694:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:0.0:1788684406.464705:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:0.0:1788684406.464710:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2393:x1875571073214080:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684406.464726:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2393:x1875571073214080:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 17us (3347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684406.464748:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00080000:3.0:1788684406.465238:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684406.465244:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788684406.526388:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788684406.866959:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788684407.296788:0:20194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe762dce50 20000000:00000080:0.0:1788684407.296806:0:20194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d67488a4000 uarg=0000000000000000 20000000:01000000:0.0:1788684407.296850:0:20194:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788684407.296856:0:20194:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788684407.296861:0:20194:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788684407.297271:0:20195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788684407.297761:0:20194:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788684407.303797:0:20194:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788684407.303828:0:20194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.303848:0:20194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad638 expref: 23 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.303857:0:20194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad646 expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.303866:0:20194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad685 expref: 23 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.303873:0:20194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad71f expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.303883:0:20194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e6d expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.303891:0:20194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3edd expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.303899:0:20194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.303943:0:20194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3edd expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.303960:0:20194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3edd expref: 12 pid: 17164 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684407.303989:0:20194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648555f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873408:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684407.304143:0:20194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e6d expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.304152:0:20194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e6d expref: 12 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684407.304162:0:20194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873536:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684407.304195:0:20194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad71f expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.304204:0:20194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad71f expref: 23 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684407.304213:0:20194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873664:0@lo:104: 00000100:00100000:0.0:1788684407.304252:0:20194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684407.304295:0:20194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad685 expref: 23 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.304304:0:20194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad685 expref: 23 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684407.304313:0:20194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873792:0@lo:104: 00000100:00100000:0.0:1788684407.304335:0:20194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684407.304667:0:20194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad646 expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.304676:0:20194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad646 expref: 23 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684407.304694:0:20194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873920:0@lo:104: 00000100:00100000:0.0:1788684407.304720:0:20194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684407.304757:0:20194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ad638 expref: 23 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684407.304766:0:20194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ad638 expref: 23 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684407.304775:0:20194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085874048:0@lo:104: 00000100:00100000:0.0:1788684407.304795:0:20194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684407.304806:0:20194:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684407.304951:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085873664 00000100:00100000:2.0:1788684407.304958:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085873664 00000100:00100000:2.0:1788684407.304992:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085873792 00000100:00100000:2.0:1788684407.304995:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085873792 00000100:00100000:2.0:1788684407.305013:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085873920 00000100:00100000:2.0:1788684407.305016:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085873920 00000100:00100000:2.0:1788684407.305024:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085874048 00000100:00100000:2.0:1788684407.305026:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085874048 00000100:00100000:2.0:1788684407.305037:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684407.305044:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+6:20194:x1875571085873664:12345-0@lo:104: 00010000:00010000:2.0:1788684407.305057:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305118:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788684407.305124:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+6:20194:x1875571085873664:12345-0@lo:104: Request processed in 80us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684407.305130:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684407.305146:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684407.305152:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+5:20194:x1875571085873792:12345-0@lo:104: 00010000:00010000:2.0:1788684407.305160:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305192:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788684407.305197:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+5:20194:x1875571085873792:12345-0@lo:104: Request processed in 46us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684407.305202:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684407.305214:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788684407.305219:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+4:20194:x1875571085873920:12345-0@lo:104: 00010000:00010000:2.0:1788684407.305225:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305265:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788684407.305275:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+4:20194:x1875571085873920:12345-0@lo:104: Request processed in 56us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684407.305281:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788684407.305292:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788684407.305298:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+3:20194:x1875571085874048:12345-0@lo:104: 00010000:00010000:2.0:1788684407.305305:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305331:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788684407.305336:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c986901f-6089-4802-a23d-1179db951431+3:20194:x1875571085874048:12345-0@lo:104: Request processed in 39us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684407.305341:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788684407.305355:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788684407.305361:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305394:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4c00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684407.305399:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305407:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684407.305414:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684407.305420:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684407.305450:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305467:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684407.305487:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305494:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d4c00/0x44bac02bd54ad71f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad726 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305506:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788684407.305509:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305520:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711ca00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684407.305524:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305531:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684407.305538:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684407.305543:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684407.305557:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305563:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684407.305577:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305583:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711ca00/0x44bac02bd54ad685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad68c expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305905:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684407.305909:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305914:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684407.305917:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305924:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684407.305931:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684407.305936:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684407.305951:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305957:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684407.305963:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305969:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711d200/0x44bac02bd54ad646 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad64d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305978:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684407.305981:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.305996:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684407.305999:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.306006:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684407.306012:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684407.306017:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788684407.306029:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.306034:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684407.306039:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.306044:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647890000/0x44bac02bd54ad638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ad63f expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.306056:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684407.306058:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684407.306060:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684407.306066:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684407.306084:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085874176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684407.306146:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684407.306184:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684407.306191:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085874560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684407.306219:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684407.306247:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085874304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684407.306267:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684407.306284:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684407.306289:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085874432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684407.306307:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684407.306329:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085874176 00000100:00100000:2.0:1788684407.306334:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085874176 00010000:00010000:2.0:1788684407.306400:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad71f expref: 24 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684407.306418:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085874560 00000100:00100000:2.0:1788684407.306422:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085874560 00010000:00010000:2.0:1788684407.306433:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad638 expref: 25 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684407.306440:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085874304 00000100:00100000:2.0:1788684407.306442:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085874304 00010000:00010000:2.0:1788684407.306449:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad685 expref: 26 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684407.306458:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085874432 00000100:00100000:2.0:1788684407.306460:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085874432 00010000:00010000:2.0:1788684407.306468:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad646 expref: 27 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684407.306479:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684407.306484:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+27:3624:x1875571085874176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684407.306494:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684407.306506:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad71f expref: 27 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.306518:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad71f expref: 27 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.306534:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684407.306565:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+27:3624:x1875571085874176:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684407.306571:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684407.306585:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788684407.306853:0:17157:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788684407.306863:0:17157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788684407.306967:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788684407.306974:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+26:3625:x1875571085874304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684407.306983:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684407.306988:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad685 expref: 26 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684407.307007:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad685 expref: 26 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684407.307018:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684407.307050:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+26:3625:x1875571085874304:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684407.307056:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788684407.307069:0:17157:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788684407.307076:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788684407.307082:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+25:3625:x1875571085874432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684407.307089:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684407.307093:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad646 expref: 25 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684407.307101:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad646 expref: 25 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684407.307110:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684407.307131:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+25:3625:x1875571085874432:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684407.307137:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788684407.307457:0:20194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711c200/0x44bac02bd54ad726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad71f expref: 24 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684407.307468:0:20194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873664:0@lo:104: 00010000:00010000:0.0:1788684407.307480:0:20194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647891600/0x44bac02bd54ad68c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad685 expref: 23 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684407.307488:0:20194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873792:0@lo:104: 00010000:00010000:0.0:1788684407.307497:0:20194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647891a00/0x44bac02bd54ad64d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad646 expref: 22 pid: 17163 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684407.307504:0:20194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873920:0@lo:104: 00000100:00100000:0.0:1788684407.307513:0:20194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085874048:0@lo:104: 00000100:00100000:2.0:1788684407.307778:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+21:3624:x1875571085874560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684407.307789:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684407.307793:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ad638 expref: 21 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.307801:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ad638 expref: 21 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.307811:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b0600/0x44bac02bd54ad63f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ad638 expref: 21 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.307820:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684407.307847:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+20:3624:x1875571085874560:12345-0@lo:103:ldlm_bl.0 Request processed in 1257us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684407.307852:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684407.307886:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085874432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684407.307893:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085874304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684407.307920:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085874560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684407.307937:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085874176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684407.314866:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684407.314894:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684407.315018:0:20196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073214720 00000100:00100000:2.0:1788684407.315028:0:20196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073214720 00010000:00010000:2.0:1788684407.315066:0:20196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e6d expref: 13 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684407.315102:0:20196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073214592 00000100:00100000:2.0:1788684407.315105:0:20196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073214592 00010000:00010000:2.0:1788684407.315117:0:20196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3edd expref: 14 pid: 17164 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684407.315143:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:2.0:1788684407.315152:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67771e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:558e5e46-625a-47f1-bf34-9eb61f632413+14:2393:x1875571073214720:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684407.315165:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684407.315171:0:17156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e6d expref: 14 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315182:0:17156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e6d expref: 14 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315202:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684407.315251:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67771e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:558e5e46-625a-47f1-bf34-9eb61f632413+14:2393:x1875571073214720:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 99us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684407.315258:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:2.0:1788684407.315299:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:2.0:1788684407.315306:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:558e5e46-625a-47f1-bf34-9eb61f632413+13:2392:x1875571073214592:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684407.315314:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684407.315333:0:17156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3edd expref: 13 pid: 17164 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315342:0:17156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3edd expref: 13 pid: 17164 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315355:0:17156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315390:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315408:0:17156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315416:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315424:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315430:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315437:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684407.315442:0:17156:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315451:0:17156:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315460:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684407.315477:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684407.315497:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:558e5e46-625a-47f1-bf34-9eb61f632413+13:2392:x1875571073214592:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 191us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684407.315504:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00010000:00010000:3.0:1788684407.315979:0:20194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54ad979 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3edd expref: 12 pid: 17164 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684407.315993:0:20194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648555f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873408:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684407.316006:0:20194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ad93a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e6d expref: 11 pid: 17165 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684407.316015:0:20194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20194:1875571085873536:192.168.206.44@tcp:104: 00010000:00010000:3.0:1788684407.316048:0:20194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684407.316058:0:20194:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684407.316065:0:20194:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684407.316072:0:20194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54ad9aa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684407.549583:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684408.576269:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684408.652098:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684408.653145:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073214848 00000100:00100000:1.0:1788684408.653156:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073214848 00000100:00100000:1.0:1788684408.653212:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 148 00000100:00100000:1.0:1788684408.653221:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+11:14908:x1875571073214848:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684408.653253:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684408.653272:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477b0800/0x44bac02bd54ad9b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f15 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684408.653299:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b0800/0x44bac02bd54ad9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f15 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684408.653310:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477b0800/0x44bac02bd54ad9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f15 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684408.653319:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0800, rc 0) 00000100:00100000:1.0:1788684408.653400:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+12:14908:x1875571073214848:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 179us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684408.653407:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 148 00000100:00100000:2.0:1788684408.661448:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684408.661754:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073214976 00000100:00100000:1.0:1788684408.661764:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073214976 00000100:00100000:1.0:1788684408.661821:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 149 00000100:00100000:1.0:1788684408.661831:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+12:14908:x1875571073214976:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684408.661975:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+12:14908:x1875571073214976:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 144us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684408.661983:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 149 00000100:00100000:2.0:1788684408.666546:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684408.666589:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073215104 00000100:00100000:2.0:1788684408.666599:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073215104 00000100:00100000:2.0:1788684408.666645:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 150 00000100:00100000:2.0:1788684408.666655:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6756554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+12:14908:x1875571073215104:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684408.666790:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6756554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+12:14908:x1875571073215104:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 136us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684408.666799:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 150 00000100:00100000:3.0:1788684408.679229:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684408.684112:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073215232 00000100:00100000:2.0:1788684408.684127:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073215232 00000100:00100000:2.0:1788684408.684198:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 151 00000100:00100000:2.0:1788684408.684209:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+12:14908:x1875571073215232:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684408.684223:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684408.684239:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d5c00/0x44bac02bd54ad9b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f1c expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684408.684266:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d5c00/0x44bac02bd54ad9b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f1c expref: 13 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684408.684277:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d5c00/0x44bac02bd54ad9b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f1c expref: 13 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684408.684305:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5c00, rc 0) 00000100:00100000:2.0:1788684408.684391:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+13:14908:x1875571073215232:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 183us (5170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684408.684398:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 151 00000100:00100000:2.0:1788684408.692922:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684408.694091:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073215360 00000100:00100000:3.0:1788684408.694103:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073215360 00000100:00100000:3.0:1788684408.694167:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:3.0:1788684408.694177:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+13:14908:x1875571073215360:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684408.694327:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+13:14908:x1875571073215360:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 151us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684408.694335:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:2.0:1788684408.706652:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684408.706837:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073215488 00000100:00100000:0.0:1788684408.706853:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073215488 00000100:00100000:0.0:1788684408.706905:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00100000:0.0:1788684408.706915:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:14908:x1875571073215488:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684408.707052:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:14908:x1875571073215488:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 137us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684408.707060:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 153 10000000:01000000:2.0:1788684409.277426:0:17168:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684409.277434:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6646ccf000 from 13 10000000:01000000:2.0:1788684409.277439:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684409.277482:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.277495:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.277507:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684409.277532:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085874688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.277615:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684409.277678:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684409.278983:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085874688 00000100:00100000:1.0:1788684409.278994:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085874688 00000100:00100000:1.0:1788684409.279153:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788684409.279165:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+20:17168:x1875571085874688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684409.279182:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684409.279206:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66477b1400/0x44bac02bd54ad9c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad9bf expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684409.279232:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66477b1400/0x44bac02bd54ad9c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad9bf expref: 21 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684409.279244:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66477b1400/0x44bac02bd54ad9c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad9bf expref: 21 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684409.279254:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1400, rc 0) 00000100:00100000:1.0:1788684409.279327:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+21:17168:x1875571085874688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684409.279334:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788684409.279461:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085874688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684409.279480:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.279489:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684409.279801:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085874816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.279838:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684409.280589:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317480 going to sleep for 11 seconds 00000100:00100000:3.0:1788684409.281531:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085874816 00000100:00100000:3.0:1788684409.282306:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085874816 00000100:00100000:3.0:1788684409.282512:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788684409.282524:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+21:17168:x1875571085874816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684409.282870:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+21:17168:x1875571085874816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684409.282879:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788684409.282967:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085874816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684409.283024:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085874944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684409.283082:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684409.283563:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684409.283788:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085874944 00000100:00100000:2.0:1788684409.283795:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085874944 00000100:00100000:2.0:1788684409.283828:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788684409.283836:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:17168:x1875571085874944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.284009:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:17168:x1875571085874944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684409.284017:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788684409.284079:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085874944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788684409.285144:0:20274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788684409.286170:0:17168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788684409.286194:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788684409.286205:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684409.286216:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684409.286227:0:17168:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788684409.286229:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677fabb800 from 13 10000000:01000000:1.0:1788684409.286232:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788684409.286270:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684409.286278:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684409.286289:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684409.286322:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788684409.286400:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684409.286437:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746044300 going to sleep for 11 seconds 00000100:00100000:2.0:1788684409.286455:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085875072 00000100:00100000:2.0:1788684409.286462:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085875072 00000100:00100000:2.0:1788684409.286508:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788684409.286517:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+21:17168:x1875571085875072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684409.286529:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684409.286753:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4000/0x44bac02bd54ad9d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad9cd expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.286779:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4000/0x44bac02bd54ad9d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad9cd expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.286790:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4000/0x44bac02bd54ad9d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad9cd expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.286810:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4000, rc 0) 00000100:00100000:2.0:1788684409.286862:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:17168:x1875571085875072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 346us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684409.286869:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788684409.287003:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684409.287018:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684409.287028:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684409.287103:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684409.287131:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684409.287209:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746044300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684409.288037:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085875200 00000100:00100000:0.0:1788684409.288044:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085875200 00000100:00100000:0.0:1788684409.288088:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788684409.288097:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+22:17168:x1875571085875200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684409.288345:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+22:17168:x1875571085875200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684409.288353:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788684409.288421:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684409.288459:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684409.288502:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684409.289327:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746044300 going to sleep for 11 seconds 00000100:00100000:2.0:1788684409.289511:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085875328 00000100:00100000:2.0:1788684409.289518:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085875328 00000100:00100000:2.0:1788684409.289585:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788684409.289595:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:17168:x1875571085875328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.289710:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+22:17168:x1875571085875328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684409.289730:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788684409.289743:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788684409.291068:0:20275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788684409.291339:0:17168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788684409.291554:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684409.291567:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.291579:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684409.291597:0:17168:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684409.291600:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d678003e800 from 13 10000000:01000000:2.0:1788684409.291603:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684409.291776:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.291785:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.291811:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684409.291835:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.291894:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684409.292025:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d4d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788684409.292302:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085875456 00000100:00100000:0.0:1788684409.292310:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085875456 00000100:00100000:0.0:1788684409.292453:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788684409.292464:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+22:17168:x1875571085875456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684409.292479:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684409.292494:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ad9e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad9db expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684409.292518:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ad9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad9db expref: 23 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684409.292857:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ad9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad9db expref: 23 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684409.292869:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3e000, rc 0) 00000100:00100000:0.0:1788684409.292968:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085875456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 506us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684409.292975:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788684409.293095:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684409.293111:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684409.293121:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684409.293281:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684409.293310:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684409.293402:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746044600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684409.293468:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085875584 00000100:00100000:0.0:1788684409.293472:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085875584 00000100:00100000:0.0:1788684409.293501:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788684409.293508:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085875584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684409.293838:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085875584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684409.293845:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788684409.293991:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684409.294021:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684409.294058:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684409.294083:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746044600 going to sleep for 11 seconds 00000100:00100000:2.0:1788684409.294120:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085875712 00000100:00100000:2.0:1788684409.294124:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085875712 00000100:00100000:2.0:1788684409.294159:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788684409.294165:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085875712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.294240:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085875712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684409.294247:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788684409.294361:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788684409.295445:0:20276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788684409.295596:0:17168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788684409.295692:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684409.295702:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.295725:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684409.295736:0:17168:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684409.295739:0:17168:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d66484cb800 from 13 10000000:01000000:2.0:1788684409.295741:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684409.295772:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.295780:0:17168:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.295800:0:17168:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684409.295820:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.295872:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684409.295985:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684409.296031:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085875840 00000100:00100000:0.0:1788684409.296037:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085875840 00000100:00100000:0.0:1788684409.296081:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788684409.296090:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+23:17168:x1875571085875840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684409.296101:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684409.296114:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3ec00/0x44bac02bd54ad9f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ad9e9 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684409.296134:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3ec00/0x44bac02bd54ad9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ad9e9 expref: 24 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684409.296145:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3ec00/0x44bac02bd54ad9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ad9e9 expref: 24 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684409.296264:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3ec00, rc 0) 00000100:00100000:0.0:1788684409.296310:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:17168:x1875571085875840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684409.296317:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788684409.296411:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684409.296424:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684409.296434:0:17168:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684409.296488:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.296515:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684409.296538:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684409.296815:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085875968 00000100:00100000:0.0:1788684409.296820:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085875968 00000100:00100000:0.0:1788684409.296855:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788684409.296863:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:17168:x1875571085875968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684409.297166:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:17168:x1875571085875968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684409.297175:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788684409.297359:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085875968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.297872:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085876096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684409.297990:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684409.298055:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6646480840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684409.298137:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085876096 00000100:00100000:0.0:1788684409.298144:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085876096 00000100:00100000:0.0:1788684409.298293:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788684409.298302:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:17168:x1875571085876096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684409.298496:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:17168:x1875571085876096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684409.298504:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788684409.298571:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c986901f-6089-4802-a23d-1179db951431:17168:1875571085876096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788684409.299561:0:20277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788684409.299976:0:17168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788684409.299999:0:17168:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788684409.300010:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684409.300022:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684409.470035:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788684409.470057:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085876224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684409.470121:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684409.470234:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684409.470283:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085876480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684409.470323:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684409.470386:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085876352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684409.470411:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684409.470443:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085876224 00000100:00100000:2.0:1788684409.470451:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085876224 00000100:00100000:2.0:1788684409.470489:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085876480 00000100:00100000:2.0:1788684409.470493:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085876480 00000100:00100000:2.0:1788684409.470508:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788684409.470516:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085876224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684409.470561:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788684409.470625:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788684409.470638:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085876480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684409.470658:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788684409.470703:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085876480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684409.470710:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788684409.470810:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085876224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 294us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684409.470816:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788684409.470835:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085876352 00000100:00100000:2.0:1788684409.470839:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085876352 00000100:00100000:2.0:1788684409.470872:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788684409.470877:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085876352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684409.470895:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684409.470924:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085876352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684409.471898:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085876224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684409.471953:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085876480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684409.471971:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085876352:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788684409.472007:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684409.472602:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1788684409.607544:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788684410.366107:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788684410.621651:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684411.144012:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.144113:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073215616 00000100:00100000:2.0:1788684411.144123:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073215616 00000100:00100000:2.0:1788684411.144196:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:2.0:1788684411.144207:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:15575:x1875571073215616:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684411.144236:0:17171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684411.144256:0:17171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad9f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f23 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144344:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144358:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144410:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144644:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144653:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144661:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144747:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54ada0c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144755:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54ada0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144763:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54ada0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684411.144794:0:17171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788684411.144798:0:17171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684411.144835:0:17171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54ada0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144857:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144873:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144880:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144886:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684411.144891:0:17171:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144898:0:17171:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144911:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f70b00) 00010000:00010000:2.0:1788684411.144913:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684411.144919:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144933:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ad9fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144947:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144952:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144957:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144968:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684411.144971:0:17171:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144976:0:17171:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144983:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d6750b68300) 00010000:00010000:2.0:1788684411.144985:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684411.144987:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.144992:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.145023:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ad9f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f23 expref: 8 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.145035:0:17171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54ada0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f23 expref: 7 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.145042:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d6750b68700) 00010000:00010000:2.0:1788684411.145044:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684411.145046:0:17171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5800, rc 0) 00000100:00100000:2.0:1788684411.145108:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:15575:x1875571073215616:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 903us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684411.145115:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00080000:3.0:1788684411.146033:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684411.148898:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.149049:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073215744 00000100:00100000:2.0:1788684411.149067:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073215744 00000100:00100000:2.0:1788684411.149168:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:2.0:1788684411.149177:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:15575:x1875571073215744:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788684411.150302:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:15575:x1875571073215744:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 Request processed in 1120us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684411.150313:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:0.0:1788684411.158399:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.160591:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073216000 00000100:00100000:2.0:1788684411.160616:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073216000 00000100:00100000:2.0:1788684411.160721:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:2.0:1788684411.160733:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:15575:x1875571073216000:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684411.160755:0:18403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684411.160779:0:18403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ada13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f2a expref: -99 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.160878:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.160894:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.160905:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.160934:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.160943:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.160950:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161097:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ada28 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161106:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ada28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161113:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ada28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684411.161123:0:18403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788684411.161794:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161804:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161812:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161818:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684411.161823:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161830:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161843:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d6750b68700) 00010000:00010000:2.0:1788684411.161846:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684411.161850:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161866:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ada1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161894:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161900:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161906:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161911:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684411.161914:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161920:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161927:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d6750b68300) 00010000:00010000:2.0:1788684411.161930:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684411.161932:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.161938:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.167351:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54ada13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f2a expref: 10 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.167696:0:18403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ada28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f2a expref: 9 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.167716:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6750b68800) 00010000:00010000:2.0:1788684411.167719:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684411.167722:0:18403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684411.167794:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:15575:x1875571073216000:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 7063us (11224us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788684411.167803:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:0.0:1788684411.180972:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.181166:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073216128 00000100:00100000:2.0:1788684411.181186:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073216128 00000100:00100000:2.0:1788684411.181257:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:2.0:1788684411.181267:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:15575:x1875571073216128:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788684411.181436:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:15575:x1875571073216128:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 170us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684411.181445:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:1.0:1788684411.191434:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.191520:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073216256 00000100:00100000:2.0:1788684411.191530:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073216256 00000100:00100000:2.0:1788684411.191648:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:2.0:1788684411.191659:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:15575:x1875571073216256:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788684411.194210:0:17172:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2511us 00000100:00080000:3.0:1788684411.198624:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684411.233447:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:15575:x1875571073216256:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 41780us (42011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684411.233461:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:1.0:1788684411.259625:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684411.260815:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073216384 00000100:00100000:0.0:1788684411.260826:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073216384 00000100:00100000:0.0:1788684411.260892:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:0.0:1788684411.260901:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:15581:x1875571073216384:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684411.260920:0:17171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684411.260939:0:17171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54ada36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f31 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.260995:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261008:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261018:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261031:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261039:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261044:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261083:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261120:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261125:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261131:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684411.261135:0:17171:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261142:0:17171:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261154:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f70b00) 00010000:00010000:0.0:1788684411.261157:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684411.261161:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261166:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54ada3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261178:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261184:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261190:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261194:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684411.261202:0:17171:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261208:0:17171:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261566:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6641869300) 00010000:00010000:0.0:1788684411.261570:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684411.261573:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261580:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54ada44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261617:0:17171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54ada36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f31 expref: 10 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261627:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f70b00) 00010000:00010000:0.0:1788684411.261630:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684411.261633:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54ada36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f31 expref: 10 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.261642:0:17171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3f200, rc 0) 00000100:00100000:1.0:1788684411.265735:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:15581:x1875571073216384:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 4822us (6106us total) trans 0 rc 301/301 00000100:00100000:1.0:1788684411.265748:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:0.0:1788684411.279273:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.279519:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073216512 00000100:00100000:1.0:1788684411.279530:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073216512 00000100:00100000:1.0:1788684411.279589:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1788684411.279599:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:15581:x1875571073216512:12345-192.168.206.44@tcp:700:lfs.0 00000100:00100000:1.0:1788684411.279716:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:15581:x1875571073216512:12345-192.168.206.44@tcp:700:lfs.0 Request processed in 107us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.279724:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:3.0:1788684411.281596:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.281726:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073216768 00000100:00100000:2.0:1788684411.281751:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073216768 00000100:00100000:2.0:1788684411.281812:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:2.0:1788684411.281820:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:15581:x1875571073216768:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:2.0:1788684411.281871:0:18403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684411.281894:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fc00/0x44bac02bd54ad964 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e9e expref: 9 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.281913:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f70b00) 00010000:00010000:2.0:1788684411.281918:0:18403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788684411.281972:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.281985:0:18403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f0e expref: 5 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.281993:0:18403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.282023:0:18403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f0e expref: 5 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.282036:0:18403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f0e expref: 5 pid: 18403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684411.282048:0:18403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18403:1875571085876608:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684411.282138:0:18403:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684411.286022:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.286126:0:18403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18403:1875571085876608:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684411.286150:0:18403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684411.287050:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073216896 00000100:00100000:0.0:1788684411.287060:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073216896 00010000:00010000:0.0:1788684411.287160:0:17156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f0e expref: 6 pid: 18403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684411.287208:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:0.0:1788684411.287387:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2393:x1875571073216896:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684411.287401:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684411.287409:0:17156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f0e expref: 6 pid: 18403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.287421:0:17156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f0e expref: 6 pid: 18403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.287443:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4600/0x44bac02bd54ad9a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f0e expref: 6 pid: 18403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.287459:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f70b00) 00010000:00010000:0.0:1788684411.287464:0:17156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.287474:0:17156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.287483:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.287514:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684411.287565:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073216896:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 182us (1552us total) trans 0 rc 0/0 00010000:00010000:1.0:1788684411.287730:0:18403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.287738:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.287760:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.287774:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.287782:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295475:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295495:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295505:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684411.295522:0:18403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000228cd08a reply state 000000000cbcbcaf transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295533:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295546:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:1.0:1788684411.295549:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684411.295552:0:18403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788684411.295557:0:18403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788684411.295566:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295584:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295591:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295597:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684411.295601:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295608:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295618:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f70b00) 00010000:00010000:1.0:1788684411.295620:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684411.295623:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295628:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ada4b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684411.295647:0:18403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000228cd08a reply state 000000000cbcbcaf transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295666:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.295672:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6752340300) 00010000:00010000:1.0:1788684411.295674:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684411.295676:0:18403:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788684411.295781:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+10:15581:x1875571073216768:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 13957us (14204us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788684411.295791:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00080000:3.0:1788684411.296137:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684411.296466:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000040:00080000:3.0:1788684411.391021:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788684411.405401:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.409058:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073217024 00000100:00100000:2.0:1788684411.409074:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073217024 00000100:00100000:3.0:1788684411.413154:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:3.0:1788684411.413169:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+10:15589:x1875571073217024:12345-192.168.206.44@tcp:101:lctl.0 00010000:00010000:3.0:1788684411.413199:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684411.413232:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ada60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f38 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.413306:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1000/0x44bac02bd54ada67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.413320:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1000/0x44bac02bd54ada67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.413334:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1000/0x44bac02bd54ada67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684411.413427:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788684411.413431:0:17173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684411.413485:0:17173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1000/0x44bac02bd54ada67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.413514:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ada60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f38 expref: 12 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.413532:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1000/0x44bac02bd54ada67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f38 expref: 11 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.413554:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684411.413558:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788684411.413561:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1000, rc 0) 00000100:00100000:3.0:1788684411.413632:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+11:15589:x1875571073217024:12345-192.168.206.44@tcp:101:lctl.0 Request processed in 466us (8271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684411.413639:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:0.0:1788684411.443304:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684411.443405:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073217152 00000100:00100000:3.0:1788684411.443414:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073217152 00000100:00100000:3.0:1788684411.443481:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:3.0:1788684411.443492:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:15590:x1875571073217152:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684411.443511:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684411.443534:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ada6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f3f expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.443602:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0e00/0x44bac02bd54ada75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.443615:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0e00/0x44bac02bd54ada75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.443626:0:17172:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0e00/0x44bac02bd54ada75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684411.443664:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788684411.443667:0:17172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684411.443686:0:17172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0e00/0x44bac02bd54ada75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.443733:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ada6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f3f expref: 7 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.443750:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0e00/0x44bac02bd54ada75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f3f expref: 6 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.443759:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684411.443762:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788684411.443765:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0e00, rc 0) 00000100:00100000:3.0:1788684411.443824:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15590:x1875571073217152:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 334us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684411.443830:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:2.0:1788684411.448418:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.448803:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073217280 00000100:00100000:1.0:1788684411.448815:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073217280 00000100:00100000:1.0:1788684411.448888:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:1.0:1788684411.448900:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:15590:x1875571073217280:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684411.448926:0:17171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684411.448953:0:17171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ada7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f46 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449022:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449038:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449051:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449092:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449109:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449115:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449207:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2200/0x44bac02bd54ada91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449215:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2200/0x44bac02bd54ada91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449222:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2200/0x44bac02bd54ada91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684411.449262:0:17171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788684411.449267:0:17171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684411.449291:0:17171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2200/0x44bac02bd54ada91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449304:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449311:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449317:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449323:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684411.449328:0:17171:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449343:0:17171:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449355:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:1.0:1788684411.449358:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684411.449387:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449396:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0400/0x44bac02bd54ada83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449409:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449415:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449421:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449426:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684411.449428:0:17171:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449434:0:17171:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449441:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6752340300) 00010000:00010000:1.0:1788684411.449444:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684411.449447:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449462:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54ada8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449787:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0600/0x44bac02bd54ada7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f46 expref: 8 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449801:0:17171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2200/0x44bac02bd54ada91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f46 expref: 7 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.449809:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:1.0:1788684411.449811:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788684411.449814:0:17171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb2200, rc 0) 00000100:00100000:1.0:1788684411.449935:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+7:15590:x1875571073217280:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1036us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.449943:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:0.0:1788684411.457061:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.457211:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073217408 00000100:00100000:1.0:1788684411.457222:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073217408 00000100:00100000:1.0:1788684411.457289:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:1.0:1788684411.457298:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:15590:x1875571073217408:12345-192.168.206.44@tcp:900:lfs.0 00000100:00100000:1.0:1788684411.457402:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:15590:x1875571073217408:12345-192.168.206.44@tcp:900:lfs.0 Request processed in 104us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.457410:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00080000:3.0:1788684411.457682:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684411.463553:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684411.463639:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073217664 00000100:00100000:3.0:1788684411.463648:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073217664 00000100:00100000:3.0:1788684411.463716:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:3.0:1788684411.463727:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+7:15590:x1875571073217664:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684411.463746:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684411.463767:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ada98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f4d expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684411.463880:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788684411.463983:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ada98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f4d expref: 9 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.463997:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684411.464015:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684411.464021:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54ada98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f4d expref: 9 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.464035:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0c00, rc 0) 00000100:00100000:3.0:1788684411.464094:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+8:15590:x1875571073217664:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 369us (549us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788684411.464101:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:0.0:1788684411.471673:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684411.471781:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073217920 00000100:00100000:3.0:1788684411.471792:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073217920 00000100:00100000:3.0:1788684411.471851:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:3.0:1788684411.471864:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+8:15590:x1875571073217920:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:3.0:1788684411.471924:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684411.471952:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2200/0x44bac02bd54ada91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f46 expref: 8 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.471972:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:3.0:1788684411.471978:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788684411.472004:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.472017:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.472027:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788684411.472231:0:17173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2153a76 reply state 00000000ae75c269 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.472257:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.472275:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:3.0:1788684411.472278:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788684411.472281:0:17173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788684411.472290:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788684411.472401:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+9:15590:x1875571073217920:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 502us (700us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788684411.472410:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:0.0:1788684411.484499:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.484599:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073218176 00000100:00100000:2.0:1788684411.484616:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073218176 00000100:00100000:2.0:1788684411.484694:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:2.0:1788684411.484715:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+9:15590:x1875571073218176:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684411.484966:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+10:15590:x1875571073218176:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 263us (480us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788684411.484974:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:0.0:1788684411.494623:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684411.494737:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073218432 00000100:00100000:3.0:1788684411.494749:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073218432 00000100:00100000:3.0:1788684411.494827:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:3.0:1788684411.494847:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+10:15590:x1875571073218432:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684411.494878:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684411.494904:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1c00/0x44bac02bd54adaad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f54 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495218:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495236:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495249:0:17172:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495261:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495303:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495310:0:17172:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684411.495501:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788684411.495600:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495609:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495617:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495623:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684411.495628:0:17172:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495636:0:17172:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495650:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684411.495653:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684411.495659:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495665:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495758:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495765:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495772:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495777:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684411.495780:0:17172:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495787:0:17172:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495795:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6752340300) 00010000:00010000:3.0:1788684411.495797:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684411.495801:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495806:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adabb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495852:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1c00/0x44bac02bd54adaad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f54 expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495864:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684411.495866:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684411.495877:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1c00/0x44bac02bd54adaad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f54 expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.495887:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1c00, rc 0) 00000100:00100000:3.0:1788684411.495974:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+11:15590:x1875571073218432:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1129us (1365us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788684411.495983:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:0.0:1788684411.499971:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.500127:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073218560 00000100:00100000:1.0:1788684411.500141:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073218560 00000100:00100000:1.0:1788684411.500255:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:1.0:1788684411.500267:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+11:15590:x1875571073218560:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684411.500317:0:17171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684411.500345:0:17171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adac9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f5b expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.500650:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.500668:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.500680:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684411.500790:0:17171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788684411.500795:0:17171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684411.500820:0:17171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.501000:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adac9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f5b expref: 13 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.501022:0:17171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f5b expref: 12 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.501032:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:1.0:1788684411.501036:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788684411.501040:0:17171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb3e00, rc 0) 00000100:00100000:1.0:1788684411.501175:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+12:15590:x1875571073218560:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 910us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.501184:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:0.0:1788684411.506561:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.509991:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073218688 00000100:00100000:2.0:1788684411.510014:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073218688 00000100:00100000:2.0:1788684411.510116:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:2.0:1788684411.510129:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+12:15590:x1875571073218688:12345-192.168.206.44@tcp:37:lfs.0 00000100:00100000:2.0:1788684411.514301:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+12:15590:x1875571073218688:12345-192.168.206.44@tcp:37:lfs.0 Request processed in 4157us (7744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684411.514320:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:1.0:1788684411.518995:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085876864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684411.519105:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684411.519171:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788684411.519179:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085876736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684411.519204:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684411.519294:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085876864 00000100:00100000:3.0:1788684411.519305:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085876864 00000100:00100000:3.0:1788684411.519397:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085876736 00000100:00100000:3.0:1788684411.519401:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085876736 00000100:00100000:3.0:1788684411.519434:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684411.519446:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085876864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788684411.519484:0:18682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788684411.519548:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085876864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684411.519557:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684411.519591:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684411.519599:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085876736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684411.519623:0:18682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684411.519656:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085876736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684411.519662:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788684411.519996:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788684411.520002:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684411.520052:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085876736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684411.520069:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085876864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684411.521400:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684411.521429:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085876992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684411.521497:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684411.521544:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085876992 00000100:00100000:3.0:1788684411.521691:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085876992 00000100:00100000:3.0:1788684411.521761:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684411.521770:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085876992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788684411.521791:0:18682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788684411.522083:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085876992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 313us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684411.522092:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788684411.522290:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684411.522304:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085877376:0@lo:400:kworker.0 00000100:00100000:1.0:1788684411.522343:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684411.522398:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085877888:0@lo:400:kworker.0 00000100:00100000:1.0:1788684411.522502:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684411.522527:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788684411.522532:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085877248:0@lo:400:kworker.0 00000100:00100000:0.0:1788684411.522729:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085877120:0@lo:400:kworker.0 00000100:00100000:0.0:1788684411.522768:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684411.522798:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085877632:0@lo:400:kworker.0 00000100:00100000:0.0:1788684411.522842:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684411.522863:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085878144:0@lo:400:kworker.0 00000100:00100000:0.0:1788684411.522885:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684411.522943:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085876992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684411.522969:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788684411.522975:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085877504:0@lo:400:kworker.0 00000100:00100000:1.0:1788684411.523016:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684411.523018:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085877120 00000100:00100000:0.0:1788684411.523026:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085877120 00000100:00100000:0.0:1788684411.523073:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788684411.523084:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:3626:x1875571085877120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684411.523102:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085877760:0@lo:400:kworker.0 00000100:00100000:0.0:1788684411.523136:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:3626:x1875571085877120:12345-0@lo:400:kworker.0 Request processed in 53us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684411.523145:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788684411.523192:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085877632 00000100:00100000:0.0:1788684411.523198:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085877632 00000100:00100000:1.0:1788684411.523210:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684411.523257:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684411.523266:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085877632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684411.523280:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085878272:0@lo:400:kworker.0 00000100:00100000:0.0:1788684411.523316:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085877632:12345-0@lo:400:kworker.0 Request processed in 49us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.523329:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684411.523347:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684411.523404:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085877248 00000100:00100000:1.0:1788684411.523428:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085877376 00000100:00100000:1.0:1788684411.523436:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085877376 00000100:00100000:1.0:1788684411.523682:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085877888 00000100:00100000:1.0:1788684411.523687:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085877888 00000100:00100000:1.0:1788684411.523721:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085878144 00000100:00100000:1.0:1788684411.523733:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085878144 00000100:00100000:1.0:1788684411.523750:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085877760 00000100:00100000:1.0:1788684411.523753:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085877760 00000100:00100000:1.0:1788684411.523763:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085878272 00000100:00100000:1.0:1788684411.523765:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085878272 00000100:00100000:1.0:1788684411.523781:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788684411.523788:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085877376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684411.523867:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085877376:12345-0@lo:400:kworker.0 Request processed in 79us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.523875:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788684411.523890:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788684411.523896:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085877888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684411.523926:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085877888:12345-0@lo:400:kworker.0 Request processed in 30us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.523933:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788684411.523955:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684411.523965:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085878144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684411.523999:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085878144:12345-0@lo:400:kworker.0 Request processed in 39us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.524005:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684411.524022:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788684411.524032:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085877760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684411.524047:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.524095:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085877760:12345-0@lo:400:kworker.0 Request processed in 64us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.524103:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788684411.524115:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788684411.524120:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085878272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684411.524155:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085878272:12345-0@lo:400:kworker.0 Request processed in 34us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.524161:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788684411.524532:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085877248 00000100:00100000:0.0:1788684411.525091:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788684411.525102:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085877248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684411.525170:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073218944 00000100:00100000:3.0:1788684411.525181:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073218944 00000100:00100000:0.0:1788684411.525192:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085877248:12345-0@lo:400:kworker.0 Request processed in 90us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684411.525200:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788684411.525245:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684411.525253:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684411.525257:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684411.525265:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:0.0:1788684411.525281:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684411.525289:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677cc63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+12:15590:x1875571073218944:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:0.0:1788684411.525340:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6780030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085878016:0@lo:400:kworker.0 00000100:00100000:3.0:1788684411.525760:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677cc63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+13:15590:x1875571073218944:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 474us (1716us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788684411.525768:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:3.0:1788684411.526016:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085877248:0@lo:400:kworker.0 00000100:00100000:3.0:1788684411.526030:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085877760:0@lo:400:kworker.0 00010000:00080000:3.0:1788684411.526044:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67450b0000 x1875571085878272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684411.526052:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085878272:0@lo:400:kworker.0 00000100:00100000:3.0:1788684411.526063:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085877376:0@lo:400:kworker.0 00000100:00100000:3.0:1788684411.526074:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085877888:0@lo:400:kworker.0 00000100:00100000:2.0:1788684411.526126:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085877504 00000100:00100000:2.0:1788684411.526136:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085877504 00000100:00100000:2.0:1788684411.526193:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788684411.526203:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085877504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684411.526276:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085877504:12345-0@lo:400:kworker.0 Request processed in 76us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684411.526283:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788684411.526892:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684411.526962:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085877120:0@lo:400:kworker.0 00000100:00100000:0.0:1788684411.526982:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085877632:0@lo:400:kworker.0 00000100:00100000:0.0:1788684411.527004:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085878144:0@lo:400:kworker.0 00000100:00100000:0.0:1788684411.527043:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085877504:0@lo:400:kworker.0 00000100:00100000:3.0:1788684411.527064:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085878016 00000100:00100000:3.0:1788684411.527075:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085878016 00000100:00100000:3.0:1788684411.527141:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788684411.527164:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085878016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684411.529010:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085878016:12345-0@lo:400:kworker.0 Request processed in 1840us (2111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684411.529024:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788684411.529758:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6780030000 x1875571085878016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684411.529774:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6780030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085878016:0@lo:400:kworker.0 00000100:00080000:2.0:1788684411.530242:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684411.582161:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684411.582218:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684411.582263:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684411.582325:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684411.582351:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684411.582408:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073219328 00000100:00100000:0.0:1788684411.582420:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073219328 00000100:00100000:3.0:1788684411.582571:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073219584 00000100:00100000:3.0:1788684411.582587:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073219584 00000100:00100000:2.0:1788684411.582659:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073219072 00000100:00100000:2.0:1788684411.582664:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073219072 00000100:00100000:2.0:1788684411.582719:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 167 00000100:00100000:2.0:1788684411.582731:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:2393:x1875571073219072:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684411.582822:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:2393:x1875571073219072:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 93us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684411.582830:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 167 00000100:00080000:2.0:1788684411.582868:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684411.583074:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073219200 00000100:00100000:0.0:1788684411.583078:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073219200 00000100:00100000:2.0:1788684411.583148:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073219456 00000100:00100000:2.0:1788684411.583153:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073219456 00000100:00080000:3.0:1788684411.584223:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684411.584254:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1788684411.584272:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073219328:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684411.584361:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073219328:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 97us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684411.584389:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1788684411.584412:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1788684411.584419:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073219584:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684411.584750:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073219584:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 330us (2485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684411.584758:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:0.0:1788684411.585252:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:0.0:1788684411.585265:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073219200:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684411.585389:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073219200:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 50us (2985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684411.585398:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1788684411.586236:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:2.0:1788684411.586255:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073219456:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684411.586311:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073219456:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 62us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684411.586329:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:3.0:1788684411.608653:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.609742:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073219712 00000100:00100000:1.0:1788684411.609760:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073219712 00000100:00100000:1.0:1788684411.609856:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:1.0:1788684411.609869:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+11:15596:x1875571073219712:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1788684411.609898:0:18403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684411.610847:0:18403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f62 expref: -99 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611339:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611359:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611398:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611412:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611421:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611428:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611529:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3000/0x44bac02bd54adaec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611558:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3000/0x44bac02bd54adaec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611577:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3000/0x44bac02bd54adaec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684411.611628:0:18403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788684411.611633:0:18403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684411.611695:0:18403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3000/0x44bac02bd54adaec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611719:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611727:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611733:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611739:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb2600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684411.611744:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611752:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611766:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:1.0:1788684411.611769:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684411.611774:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611792:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611809:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611815:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611821:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611826:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684411.611829:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611836:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611844:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6752340300) 00010000:00010000:1.0:1788684411.611847:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684411.611850:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611857:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adae5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611896:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f62 expref: 13 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611937:0:18403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3000/0x44bac02bd54adaec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f62 expref: 12 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.611945:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:1.0:1788684411.611948:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788684411.611951:0:18403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb3000, rc 0) 00000100:00100000:1.0:1788684411.612045:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+12:15596:x1875571073219712:12345-192.168.206.44@tcp:101:bash.0 Request processed in 2177us (3406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.612056:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:2.0:1788684411.618761:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.618855:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073219840 00000100:00100000:1.0:1788684411.618870:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073219840 00000100:00100000:1.0:1788684411.618960:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:1.0:1788684411.618974:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:15596:x1875571073219840:12345-192.168.206.44@tcp:900:bash.0 00000100:00100000:1.0:1788684411.619089:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:15596:x1875571073219840:12345-192.168.206.44@tcp:900:bash.0 Request processed in 117us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.619099:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:0.0:1788684411.622192:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684411.622415:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073220096 00000100:00100000:3.0:1788684411.622431:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073220096 00000100:00100000:3.0:1788684411.622516:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:3.0:1788684411.622529:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+12:15596:x1875571073220096:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1788684411.622557:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684411.622601:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1c00/0x44bac02bd54adaf3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f69 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.622791:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.622809:0:17173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f5b expref: 12 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.622820:0:17173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.622861:0:17173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f5b expref: 12 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.622878:0:17173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f5b expref: 12 pid: 17171 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684411.622898:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085878400:192.168.206.44@tcp:104: 00000100:00100000:3.0:1788684411.623143:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677fb30180 going to sleep for 11 seconds 00000100:00100000:0.0:1788684411.626904:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085878400:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684411.626963:0:17173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684411.627255:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.627353:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073220224 00000100:00100000:1.0:1788684411.627406:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073220224 00010000:00010000:1.0:1788684411.627456:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f5b expref: 13 pid: 17171 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684411.627492:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:1.0:1788684411.627502:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+13:2392:x1875571073220224:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684411.627519:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684411.627527:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f5b expref: 13 pid: 17171 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.627559:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f5b expref: 13 pid: 17171 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.627789:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adad0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f5b expref: 13 pid: 17171 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.627811:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:1.0:1788684411.627817:0:17157:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.627829:0:17157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.627839:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.627872:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684411.627956:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+12:2392:x1875571073220224:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 455us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.627965:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00010000:00010000:0.0:1788684411.628037:0:17173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.628046:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.628077:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.628090:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.628099:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629116:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629143:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629156:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684411.629176:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788684411.629235:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629243:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629252:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629258:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684411.629263:0:17173:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629271:0:17173:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629286:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:0.0:1788684411.629290:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684411.629297:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629326:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0600/0x44bac02bd54adafa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788684411.629352:0:17173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f828ccff reply state 00000000f979451a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629363:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.629443:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d6641869300) 00010000:00010000:0.0:1788684411.629446:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788684411.635649:0:17173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788684411.635731:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1c00/0x44bac02bd54adaf3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f69 expref: 15 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.635759:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f69 expref: 14 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.635768:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684411.635771:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788684411.635774:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3f400, rc 0) 00000100:00100000:0.0:1788684411.635838:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+15:15596:x1875571073220096:12345-192.168.206.44@tcp:101:bash.0 Request processed in 13312us (13661us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788684411.635847:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 37 00010000:00010000:1.0:1788684411.645574:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684411.655390:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.656114:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073220352 00000100:00100000:2.0:1788684411.656133:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073220352 00000100:00100000:2.0:1788684411.656210:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:2.0:1788684411.656222:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+15:15596:x1875571073220352:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684411.656249:0:17171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684411.656271:0:17171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54adb16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f70 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.656328:0:17171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.656357:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.656416:0:17171:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684411.656475:0:17171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788684411.656480:0:17171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684411.656511:0:17171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.656521:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.656544:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54adb16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f70 expref: 17 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.656562:0:17171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f70 expref: 16 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684411.656735:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:2.0:1788684411.656738:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684411.656741:0:17171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5e00, rc 0) 00000100:00100000:2.0:1788684411.656806:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+16:15596:x1875571073220352:12345-192.168.206.44@tcp:101:bash.0 Request processed in 585us (4680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684411.656813:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:2.0:1788684411.661714:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.661790:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073220608 00000100:00100000:1.0:1788684411.661806:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073220608 00000100:00100000:1.0:1788684411.661890:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:1.0:1788684411.661902:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+16:15596:x1875571073220608:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:1.0:1788684411.662302:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+17:15596:x1875571073220608:12345-192.168.206.44@tcp:35:bash.0 Request processed in 400us (607us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788684411.662333:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:1.0:1788684411.778124:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684411.778227:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073220864 00000100:00100000:3.0:1788684411.778241:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073220864 00000100:00100000:3.0:1788684411.778316:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:3.0:1788684411.778327:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+17:15606:x1875571073220864:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1788684411.778359:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684411.778430:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adb24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f77 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684411.778621:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788684411.778770:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adb24 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f77 expref: 19 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.778787:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:3.0:1788684411.778790:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788684411.778796:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1400/0x44bac02bd54adb24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f77 expref: 19 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684411.778811:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1400, rc 0) 00000100:00100000:3.0:1788684411.778892:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+18:15606:x1875571073220864:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 567us (781us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788684411.778901:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:0.0:1788684411.785138:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.785281:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073221120 00000100:00100000:1.0:1788684411.785294:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073221120 00000100:00100000:1.0:1788684411.785391:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:1.0:1788684411.785405:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+18:15606:x1875571073221120:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684411.785719:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+19:15606:x1875571073221120:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 316us (606us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788684411.785727:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:3.0:1788684411.834199:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.834335:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073221376 00000100:00100000:1.0:1788684411.834347:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073221376 00000100:00100000:1.0:1788684411.834462:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:1.0:1788684411.834475:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+19:15609:x1875571073221376:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684411.834508:0:18403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684411.834536:0:18403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adb32 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f7e expref: -99 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.834892:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adb39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.834911:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adb39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.834924:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adb39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684411.834938:0:18403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788684411.835097:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adb32 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f7e expref: 22 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.835120:0:18403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adb39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f7e expref: 21 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.835130:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684411.835133:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788684411.835138:0:18403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb3c00, rc 0) 00000100:00100000:1.0:1788684411.835223:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+21:15609:x1875571073221376:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 750us (1039us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788684411.835233:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:2.0:1788684411.842085:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684411.842143:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.842250:0:20196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073221504 00000100:00100000:1.0:1788684411.842262:0:20196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073221504 00000100:00100000:1.0:1788684411.842335:0:20196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1788684411.842346:0:20196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+21:2392:x1875571073221504:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684411.842388:0:20196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684411.842417:0:20196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adb39 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f7e expref: 21 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684411.842440:0:20196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684411.842445:0:20196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684411.842511:0:20196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+20:2392:x1875571073221504:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 167us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684411.842519:0:20196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:0.0:1788684411.842593:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073221632 00000100:00100000:0.0:1788684411.842597:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073221632 00000100:00100000:0.0:1788684411.842644:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:0.0:1788684411.842659:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+20:15609:x1875571073221632:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:0.0:1788684411.842735:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.842751:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.842762:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.842801:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.842808:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.842815:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.842821:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3e800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684411.842826:0:17173:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.842834:0:17173:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.842842:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684411.842845:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788684411.842849:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684411.842855:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adb47 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684411.842898:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+20:15609:x1875571073221632:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 241us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684411.842905:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:0.0:1788684411.845846:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684411.846026:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073221888 00000100:00100000:1.0:1788684411.846038:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073221888 00000100:00100000:1.0:1788684411.846118:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:1.0:1788684411.846128:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+20:15609:x1875571073221888:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684411.846422:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+21:15609:x1875571073221888:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 293us (589us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788684411.846431:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000040:00080000:2.0:1788684411.966442:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788684412.161027:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684412.161162:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073222144 00000100:00100000:1.0:1788684412.161175:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073222144 00000100:00100000:1.0:1788684412.161251:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:1.0:1788684412.161264:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+21:15640:x1875571073222144:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:1.0:1788684412.161296:0:18403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684412.161323:0:18403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adb4e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f85 expref: -99 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.161511:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adb55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.161530:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adb55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.161547:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adb55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684412.161561:0:18403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788684412.161743:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adb4e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f85 expref: 24 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.161767:0:18403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adb55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f85 expref: 23 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.161802:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684412.161805:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788684412.161809:0:18403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb3e00, rc 0) 00000100:00100000:1.0:1788684412.161886:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+23:15640:x1875571073222144:12345-192.168.206.44@tcp:101:cat.0 Request processed in 624us (873us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788684412.161894:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:2.0:1788684412.170791:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684412.170937:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684412.171041:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073222528 00000100:00100000:0.0:1788684412.171055:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073222528 00000100:00100000:0.0:1788684412.171149:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:0.0:1788684412.171162:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+23:2393:x1875571073222528:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684412.171180:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788684412.171187:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073222400 00000100:00100000:1.0:1788684412.171198:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073222400 00010000:00010000:0.0:1788684412.171208:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3e00/0x44bac02bd54adb55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f85 expref: 24 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.171232:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684412.171238:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684412.171252:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:1.0:1788684412.171264:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+23:15640:x1875571073222400:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:0.0:1788684412.171487:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+23:2393:x1875571073222528:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 326us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684412.171497:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:1.0:1788684412.171656:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+23:15640:x1875571073222400:12345-192.168.206.44@tcp:35:cat.0 Request processed in 392us (877us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788684412.171665:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:2.0:1788684412.242891:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684412.243028:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073222784 00000100:00100000:0.0:1788684412.243042:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073222784 00000100:00100000:0.0:1788684412.243126:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:0.0:1788684412.243140:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+23:15646:x1875571073222784:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:0.0:1788684412.243174:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684412.243205:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adb63 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f8c expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.243415:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.243452:0:17173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f69 expref: 24 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.243462:0:17173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f70 expref: 24 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.243472:0:17173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.243517:0:17173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f70 expref: 24 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.243534:0:17173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f70 expref: 24 pid: 17171 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684412.243571:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085878528:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684412.243691:0:17173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f69 expref: 24 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.243713:0:17173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f69 expref: 24 pid: 17173 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684412.243723:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085878656:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684412.243752:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677726c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788684412.251622:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085878528:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684412.252664:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684412.252776:0:20196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073222912 00000100:00100000:1.0:1788684412.252786:0:20196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073222912 00010000:00010000:1.0:1788684412.252838:0:20196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f70 expref: 25 pid: 17171 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684412.252885:0:20196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684412.252896:0:20196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+25:2392:x1875571073222912:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684412.252915:0:20196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684412.252928:0:20196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f70 expref: 25 pid: 17171 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.252943:0:20196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f70 expref: 25 pid: 17171 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.252990:0:20196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb1d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f70 expref: 25 pid: 17171 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.253011:0:20196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684412.253017:0:20196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.253026:0:20196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.253034:0:20196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684412.253113:0:20196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+24:2392:x1875571073222912:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 218us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684412.253121:0:20196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1788684412.256426:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684412.256449:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085878656:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684412.256489:0:17173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684412.256969:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073223040 00000100:00100000:0.0:1788684412.256997:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073223040 00010000:00010000:0.0:1788684412.257044:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f69 expref: 24 pid: 17173 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684412.257099:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:0.0:1788684412.257119:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67771e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+24:2392:x1875571073223040:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684412.257138:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684412.257146:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f69 expref: 24 pid: 17173 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.257159:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f69 expref: 24 pid: 17173 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.257186:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb08 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f69 expref: 24 pid: 17173 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.257204:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684412.257218:0:17158:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.257229:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.257238:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.257266:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684412.257346:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67771e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+23:2392:x1875571073223040:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 226us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684412.257408:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00010000:00010000:1.0:1788684412.257729:0:17173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.257739:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684412.257762:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788684412.257969:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adb63 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f8c expref: 24 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.258003:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f8c expref: 23 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.258013:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684412.258017:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788684412.258020:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3ee00, rc 0) 00000100:00100000:1.0:1788684412.258059:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+23:15646:x1875571073222784:12345-192.168.206.44@tcp:101:dd.0 Request processed in 14924us (15185us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788684412.258068:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:0.0:1788684412.265551:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684412.265611:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073223168 00000100:00100000:1.0:1788684412.265630:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073223168 00000100:00100000:1.0:1788684412.265725:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:1.0:1788684412.265738:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+23:15646:x1875571073223168:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:1.0:1788684412.265768:0:18403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684412.265798:0:18403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adb78 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f93 expref: -99 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.265844:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.265862:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.265876:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.266034:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adb78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f93 expref: 25 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.266064:0:18403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f93 expref: 24 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.266074:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684412.266077:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788684412.266081:0:18403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb3400, rc 0) 00000100:00100000:1.0:1788684412.266181:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+24:15646:x1875571073223168:12345-192.168.206.44@tcp:101:dd.0 Request processed in 444us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684412.266189:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:3.0:1788684412.270306:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684412.271179:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073223424 00000100:00100000:1.0:1788684412.271198:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073223424 00000100:00100000:1.0:1788684412.271357:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:1.0:1788684412.271391:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+24:15646:x1875571073223424:12345-192.168.206.44@tcp:36:dd.0 00010000:00010000:1.0:1788684412.271846:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.271870:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.271884:0:17172:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788684412.271964:0:17172:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788684412.271995:0:17172:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e790884 reply state 000000000507d3c2 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.272010:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.272038:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684412.272041:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684412.272046:0:17172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788684412.272300:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+27:15646:x1875571073223424:12345-192.168.206.44@tcp:36:dd.0 Request processed in 930us (2005us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788684412.272309:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000020:00080000:1.0:1788684412.272316:0:17172:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788684412.274964:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684412.276812:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073223552 00000100:00100000:2.0:1788684412.276832:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073223552 00000100:00100000:2.0:1788684412.276938:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:2.0:1788684412.276951:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+27:15646:x1875571073223552:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:2.0:1788684412.276985:0:17171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684412.277015:0:17171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb8d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3f9a expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684412.277104:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f9a expref: 28 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684412.277122:0:17171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f9a expref: 28 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684412.277144:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:2.0:1788684412.277147:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684412.277152:0:17171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5e00, rc 0) 00000100:00100000:2.0:1788684412.277242:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+28:15646:x1875571073223552:12345-192.168.206.44@tcp:101:dd.0 Request processed in 293us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684412.277250:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:3.0:1788684412.287598:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684412.287735:0:20196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073223808 00000100:00100000:1.0:1788684412.287748:0:20196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073223808 00000100:00100000:1.0:1788684412.287824:0:20196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:1.0:1788684412.287835:0:20196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+28:15646:x1875571073223808:12345-192.168.206.44@tcp:103:dd.0 00010000:00010000:1.0:1788684412.287853:0:20196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684412.287882:0:20196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54adb8d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f9a expref: 28 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.287909:0:20196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684412.287922:0:20196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684412.287986:0:20196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+27:15646:x1875571073223808:12345-192.168.206.44@tcp:103:dd.0 Request processed in 154us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684412.287994:0:20196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:3.0:1788684412.290306:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684412.290543:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073223936 00000100:00100000:0.0:1788684412.290554:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073223936 00000100:00100000:0.0:1788684412.290631:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:0.0:1788684412.290642:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+27:15646:x1875571073223936:12345-192.168.206.44@tcp:58:dd.0 00010000:00010000:0.0:1788684412.290798:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.290821:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684412.290836:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684412.297919:0:17173:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684412.300791:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788684412.300962:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788684412.301072:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+27:15646:x1875571073223936:12345-192.168.206.44@tcp:58:dd.0 Request processed in 10425us (10778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684412.301085:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:3.0:1788684412.307894:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684412.308109:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073224064 00000100:00100000:2.0:1788684412.308118:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073224064 00000100:00100000:2.0:1788684412.308267:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:2.0:1788684412.308278:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+27:15646:x1875571073224064:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:2.0:1788684412.308299:0:17171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684412.308319:0:17171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3fa1 expref: -99 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684412.308407:0:17171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684412.308418:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa1 expref: 28 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684412.310727:0:17171:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684412.310768:0:17171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa1 expref: 28 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684412.310784:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:2.0:1788684412.310788:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684412.310792:0:17171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa1 expref: 28 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684412.310802:0:17171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4c00, rc 0) 00000100:00100000:2.0:1788684412.310872:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+28:15646:x1875571073224064:12345-192.168.206.44@tcp:101:dd.0 Request processed in 2595us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684412.310881:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 48 00010000:00010000:1.0:1788684412.670058:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788684412.990028:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788684412.990048:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788684412.990091:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788684412.990101:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788684412.990237:0:17206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17206:1875571085878784:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788684412.990322:0:17206:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684412.993875:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684412.994001:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073224192 00000100:00100000:1.0:1788684412.994013:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073224192 00000100:00100000:1.0:1788684412.994087:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:1.0:1788684412.994099:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+29:15647:x1875571073224192:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788684412.994142:0:17172:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788684412.994360:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+29:15647:x1875571073224192:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 263us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684412.994426:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:3.0:1788684412.998436:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684412.998854:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073224320 00000100:00100000:1.0:1788684412.998869:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073224320 00000100:00100000:1.0:1788684412.998953:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:1.0:1788684412.998966:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+29:15647:x1875571073224320:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788684412.999073:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999095:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999108:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999543:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999571:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999584:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999620:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999631:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999638:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684412.999721:0:18403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788684412.999726:0:18403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684412.999747:0:18403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999759:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999764:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999771:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999777:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684412.999781:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999789:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999802:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6750b68800) 00010000:00010000:1.0:1788684412.999805:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684412.999810:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999816:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3c00/0x44bac02bd54adba2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999831:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999847:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999853:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999858:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684412.999861:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999868:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999875:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d6752340400) 00010000:00010000:1.0:1788684412.999877:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684412.999880:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999885:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3600/0x44bac02bd54adba9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999901:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999907:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999914:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999918:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684412.999926:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999933:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999940:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684412.999943:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684412.999945:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684412.999951:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684413.000052:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+29:15647:x1875571073224320:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 1085us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.000062:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:3.0:1788684413.007189:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684413.007526:0:17206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17206:1875571085878784:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788684413.009269:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073224576 00000100:00100000:1.0:1788684413.009284:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073224576 00000100:00100000:1.0:1788684413.009362:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:1.0:1788684413.009406:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+28:15647:x1875571073224576:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00000100:00080000:3.0:1788684413.009478:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788684413.009736:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684413.009759:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3fa8 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.009859:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.009873:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.009903:0:17172:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684413.009914:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788684413.009978:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.009986:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.009992:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.009998:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.010002:0:17172:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.010009:0:17172:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.010019:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684413.010022:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788684413.010026:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.010032:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbbe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.010068:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbb7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa8 expref: 30 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.010088:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6750b68800) 00010000:00010000:1.0:1788684413.010090:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684413.010094:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa8 expref: 30 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.010103:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb2e00, rc 0) 00000100:00100000:1.0:1788684413.010170:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+29:15647:x1875571073224576:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 781us (2999us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788684413.010179:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:0.0:1788684413.018759:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.018896:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073224704 00000100:00100000:1.0:1788684413.018906:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073224704 00000100:00100000:1.0:1788684413.018964:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:1.0:1788684413.018974:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+29:15647:x1875571073224704:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788684413.019007:0:18403:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788684413.019133:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+29:15647:x1875571073224704:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 159us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.019141:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:3.0:1788684413.028884:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.029241:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073224960 00000100:00100000:0.0:1788684413.029250:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073224960 00000100:00100000:0.0:1788684413.029308:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:0.0:1788684413.029318:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+29:15647:x1875571073224960:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684413.029338:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684413.029357:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54adbcc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3faf expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788684413.029774:0:17173:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:0.0:1788684413.029781:0:17173:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788684413.029797:0:17173:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788684413.029923:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fa00/0x44bac02bd54adbd3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.029938:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fa00/0x44bac02bd54adbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.029948:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fa00/0x44bac02bd54adbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.029996:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f000/0x44bac02bd54adbcc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3faf expref: 32 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.030013:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fa00/0x44bac02bd54adbd3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3faf expref: 31 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.030021:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869800) 00010000:00010000:0.0:1788684413.030024:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684413.030027:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3fa00, rc 0) 00000100:00100000:0.0:1788684413.030097:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+31:15647:x1875571073224960:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 780us (1222us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788684413.030104:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:2.0:1788684413.034110:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.034271:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073225216 00000100:00100000:1.0:1788684413.034282:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073225216 00000100:00100000:1.0:1788684413.034339:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:1.0:1788684413.034348:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+31:15647:x1875571073225216:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788684413.034442:0:18403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684413.034468:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fa00/0x44bac02bd54adbd3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3faf expref: 31 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034504:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869800) 00010000:00010000:1.0:1788684413.034515:0:18403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684413.034536:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034550:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034559:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034627:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034636:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034643:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034683:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034690:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034711:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034717:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb2e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.034721:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034735:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034745:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:1.0:1788684413.034747:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684413.034751:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034757:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adbe1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034766:0:18403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034771:0:18403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034777:0:18403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034782:0:18403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.034785:0:18403:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034791:0:18403:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034798:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2b71b3f6 (ffff8d6752340400) 00010000:00010000:1.0:1788684413.034800:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684413.034803:0:18403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.034820:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adbe8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2b71b3f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684413.034902:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+30:15647:x1875571073225216:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 555us (802us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788684413.034909:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:3.0:1788684413.037599:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.037691:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073225344 00000100:00100000:0.0:1788684413.037713:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073225344 00000100:00100000:0.0:1788684413.037769:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:0.0:1788684413.037779:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+30:15647:x1875571073225344:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684413.037806:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684413.037828:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adbef lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3fb6 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.037862:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e200/0x44bac02bd54adbf6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.037875:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e200/0x44bac02bd54adbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.037885:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e200/0x44bac02bd54adbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.037986:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adbef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fb6 expref: 32 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.038005:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e200/0x44bac02bd54adbf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fb6 expref: 31 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.038015:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:0.0:1788684413.038018:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788684413.038021:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3e200, rc 0) 00000100:00100000:0.0:1788684413.038142:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+31:15647:x1875571073225344:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 364us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684413.038149:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:0.0:1788684413.046504:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.046580:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073225600 00000100:00100000:1.0:1788684413.046590:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073225600 00000100:00100000:1.0:1788684413.046649:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:1.0:1788684413.046660:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+31:15647:x1875571073225600:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788684413.046754:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.046771:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.046782:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788684413.046931:0:18403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788684413.046940:0:18403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 494040573256ns, next at 495040571296ns, rc = 0 00000004:00010000:1.0:1788684413.046984:0:18403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b33f9d3 reply state 00000000c210b97d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.046997:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.047005:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:1.0:1788684413.047021:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788684413.047025:0:18403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788684413.047117:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+33:15647:x1875571073225600:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 458us (621us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788684413.047125:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:2.0:1788684413.052532:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.053221:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073225728 00000100:00100000:0.0:1788684413.053233:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073225728 00000100:00100000:0.0:1788684413.053350:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:0.0:1788684413.053410:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+33:15647:x1875571073225728:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684413.053436:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684413.053456:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3fbd expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.053512:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fbd expref: 34 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.053527:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fbd expref: 34 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.053547:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:0.0:1788684413.053550:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788684413.053554:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3fe00, rc 0) 00000100:00100000:0.0:1788684413.053713:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+34:15647:x1875571073225728:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 306us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684413.053721:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:0.0:1788684413.059107:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.059273:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073225856 00000100:00100000:1.0:1788684413.059282:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073225856 00000100:00100000:1.0:1788684413.059349:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:1.0:1788684413.059359:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073225856:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788684413.059443:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684413.059833:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:2393:x1875571073225856:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 474us (733us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788684413.059841:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:3.0:1788684413.071902:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.072022:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073226112 00000100:00100000:0.0:1788684413.072033:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073226112 00000100:00100000:0.0:1788684413.072091:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:0.0:1788684413.072100:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+34:15647:x1875571073226112:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788684413.072314:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+35:15647:x1875571073226112:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 214us (421us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788684413.072322:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:2.0:1788684413.074866:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.074970:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073226368 00000100:00100000:1.0:1788684413.074979:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073226368 00000100:00100000:1.0:1788684413.075038:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:1.0:1788684413.075048:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+35:15647:x1875571073226368:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788684413.075180:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+35:15647:x1875571073226368:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 132us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.075188:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:3.0:1788684413.078358:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.079017:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073226496 00000100:00100000:1.0:1788684413.079027:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073226496 00000100:00100000:1.0:1788684413.079088:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:1.0:1788684413.079098:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+35:15647:x1875571073226496:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684413.079128:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684413.079148:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adc0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3fc4 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.079232:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.079246:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.079256:0:17172:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684413.079296:0:17172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684413.079314:0:17172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.079340:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3800/0x44bac02bd54adc0b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fc4 expref: 37 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.079360:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fc4 expref: 36 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.079421:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:1.0:1788684413.079424:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788684413.079427:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb2e00, rc 0) 00000100:00100000:1.0:1788684413.079491:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+36:15647:x1875571073226496:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 394us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.079499:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1788684413.082717:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684413.083352:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073226624 00000100:00100000:2.0:1788684413.083403:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073226624 00000100:00100000:2.0:1788684413.083463:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1788684413.083473:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+6:2392:x1875571073226624:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684413.083491:0:18680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684413.083513:0:18680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3fcb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684413.083538:0:18680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d287d, blocks: 0x0 00010000:00010000:2.0:1788684413.083569:0:18680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788684413.083573:0:18680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684413.083582:0:18680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fcb expref: 7 pid: 18680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.083601:0:18680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fcb expref: 7 pid: 18680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.083637:0:18680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4600, rc 0) 00000100:00100000:2.0:1788684413.083712:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:2392:x1875571073226624:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 224us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684413.083719:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:3.0:1788684413.095101:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.095264:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073226880 00000100:00100000:1.0:1788684413.095274:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073226880 00000100:00100000:1.0:1788684413.095333:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:1.0:1788684413.095354:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+36:15647:x1875571073226880:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788684413.095502:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+36:15647:x1875571073226880:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 149us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.095510:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:3.0:1788684413.100559:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.100862:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073227008 00000100:00100000:1.0:1788684413.100872:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073227008 00000100:00100000:1.0:1788684413.100935:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:1.0:1788684413.100945:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+36:15647:x1875571073227008:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788684413.104278:0:17151:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788684413.104298:0:17151:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788684413.104347:0:17151:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788684413.104542:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684413.104572:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085878912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788684413.104638:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684413.104682:0:19567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085878912 00000100:00100000:3.0:1788684413.104687:0:19567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085878912 00000100:00100000:3.0:1788684413.104753:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684413.104762:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d675ecbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085878912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788684413.104873:0:19567:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788684413.104876:0:19567:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788684413.104879:0:19567:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788684413.104881:0:19567:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788684413 -> 1788684413 00002000:00010000:3.0:1788684413.104883:0:19567:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788684413.104931:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d675ecbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085878912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (292us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788684413.104938:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788684413.105066:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788684413.105096:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d6648667b80/2, rc 0, transno 8589934596 00000100:00100000:3.0:1788684413.105101:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085878912:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788684413.105443:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105455:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105462:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105467:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.105472:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105480:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105495:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6752340300) 00010000:00010000:1.0:1788684413.105498:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684413.105502:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105525:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1600/0x44bac02bd54ada52 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105545:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105550:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105570:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105574:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.105577:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105584:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105591:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:1.0:1788684413.105594:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684413.105597:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105602:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0000/0x44bac02bd54ada59 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105615:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105620:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105633:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105638:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.105641:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105647:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105655:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d6641869300) 00010000:00010000:1.0:1788684413.105658:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684413.105660:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105666:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f600/0x44bac02bd54adb01 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105683:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105689:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105709:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105714:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb2600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.105716:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105731:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105739:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684413.105741:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684413.105744:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105749:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adb86 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105760:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105766:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105772:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105777:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.105779:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105785:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105791:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:1.0:1788684413.105793:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788684413.105795:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.105813:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adbfd lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684413.105929:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+15:15647:x1875571073227008:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 4983us (5375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.105938:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00010000:00010000:0.0:1788684413.106187:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.106202:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.106209:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.106214:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684413.106217:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.106223:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.106233:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:0.0:1788684413.106235:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788684413.106238:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.106245:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0c00/0x44bac02bd54adaa6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684413.109793:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.109933:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073227136 00000100:00100000:1.0:1788684413.109942:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073227136 00000100:00100000:1.0:1788684413.109996:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:1.0:1788684413.110006:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:2393:x1875571073227136:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788684413.110107:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:2393:x1875571073227136:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 102us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.110123:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:3.0:1788684413.116094:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.116187:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073227392 00000100:00100000:1.0:1788684413.116198:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073227392 00000100:00100000:1.0:1788684413.116257:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:1.0:1788684413.116268:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+15:15647:x1875571073227392:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788684413.116318:0:18403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684413.116345:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc12 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fc4 expref: 15 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.116418:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:1.0:1788684413.116424:0:18403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684413.116451:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.116482:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.116493:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684413.116628:0:18403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b129624 reply state 000000005f37c44e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.116640:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.116646:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:1.0:1788684413.116649:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684413.116652:0:18403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788684413.116836:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+16:15647:x1875571073227392:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 567us (748us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788684413.116844:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:3.0:1788684413.121505:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.121593:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073227520 00000100:00100000:1.0:1788684413.121607:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073227520 00000100:00100000:1.0:1788684413.121677:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:1.0:1788684413.121688:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:15647:x1875571073227520:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684413.121719:0:18679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684413.121738:0:18679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3fd2 expref: -99 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.121771:0:18679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fcb expref: 8 pid: 18680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.121799:0:18679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684413.121803:0:18679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684413.121809:0:18679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 8 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.121845:0:18679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fcb expref: 8 pid: 18680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.121859:0:18679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fcb expref: 8 pid: 18680 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684413.121875:0:18679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18679:1875571085879040:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684413.121981:0:18679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684413.134492:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.134582:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073227648 00000100:00100000:0.0:1788684413.134591:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073227648 00010000:00010000:0.0:1788684413.134633:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fcb expref: 9 pid: 18680 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684413.134680:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:0.0:1788684413.134692:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:2391:x1875571073227648:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684413.134739:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684413.134767:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fcb expref: 9 pid: 18680 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.134783:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fcb expref: 9 pid: 18680 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.134809:0:17158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684413.134814:0:17158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684413.134821:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 9 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.134830:0:17158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 9 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.134867:0:17158:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 9 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684413.134881:0:17158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17158:1875571085879168:192.168.206.44@tcp:105: 00000100:00100000:0.0:1788684413.134960:0:17158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd56c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788684413.135458:0:18679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54adc19 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fcb expref: 9 pid: 18680 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684413.135475:0:18679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18679:1875571085879040:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684413.135499:0:18679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 8 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.135510:0:18679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb2e00, rc 0) 00000100:00100000:1.0:1788684413.135544:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+8:15647:x1875571073227520:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 13858us (14053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.135563:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:2.0:1788684413.139461:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684413.139552:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073227776 00000100:00100000:0.0:1788684413.139586:0:17158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17158:1875571085879168:192.168.206.44@tcp:105: 00000100:00100000:3.0:1788684413.139588:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073227776 00010000:00010000:0.0:1788684413.139616:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684413.139663:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:0.0:1788684413.139675:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+8:2391:x1875571073227648:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 4983us (5189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684413.139680:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+8:2392:x1875571073227776:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788684413.139706:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00002000:00010000:3.0:1788684413.139892:0:19204:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788684413.139898:0:19204:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788684412 00002000:00010000:3.0:1788684413.139900:0:19204:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788684411 00002000:00010000:3.0:1788684413.139903:0:19204:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788684413 -> 1788684412 00002000:00010000:3.0:1788684413.139905:0:19204:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788684413.139959:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+8:2392:x1875571073227776:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 285us (505us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788684413.139968:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:3.0:1788684413.148212:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684413.148406:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073227904 00000100:00100000:2.0:1788684413.148421:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073227904 00000100:00100000:2.0:1788684413.148494:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:2.0:1788684413.148505:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+8:2392:x1875571073227904:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788684413.148572:0:18680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.148600:0:18680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 8 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.148611:0:18680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684413.148616:0:18680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788684413.148622:0:18680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.148666:0:18680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 8 pid: 18679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.148711:0:18680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 8 pid: 18679 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684413.148729:0:18680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18680:1875571085879296:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684413.148837:0:18680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674702d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684413.155756:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.155916:0:18680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18680:1875571085879296:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684413.155952:0:18680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684413.161258:0:20196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073228032 00000100:00100000:1.0:1788684413.161282:0:20196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073228032 00010000:00010000:1.0:1788684413.161357:0:20196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 9 pid: 18679 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684413.161515:0:20196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1788684413.161528:0:20196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+9:2392:x1875571073228032:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684413.161549:0:20196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684413.161594:0:20196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 9 pid: 18679 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.161613:0:20196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 9 pid: 18679 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.161662:0:20196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54adc27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd2 expref: 9 pid: 18679 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.161687:0:20196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788684413.161701:0:20196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788684413.161711:0:20196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.161725:0:20196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.161785:0:20196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684413.161875:0:20196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+8:2392:x1875571073228032:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 349us (6135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.161883:0:20196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00010000:00010000:0.0:1788684413.163701:0:18680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.163726:0:18680:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.163765:0:18680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.163774:0:18680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.163785:0:18680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.163793:0:18680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684413.163798:0:18680:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.163807:0:18680:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.163858:0:18680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.163866:0:18680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54adc2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684413.164001:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:2392:x1875571073227904:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 15493us (15798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684413.164012:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:2.0:1788684413.177608:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.184787:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073228288 00000100:00100000:0.0:1788684413.184809:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073228288 00000100:00100000:0.0:1788684413.184970:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:0.0:1788684413.184983:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+16:15647:x1875571073228288:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788684413.185095:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.185118:0:17173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f93 expref: 16 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.185129:0:17173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.185179:0:17173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f93 expref: 16 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.185196:0:17173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f93 expref: 16 pid: 18403 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684413.185245:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085879424:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684413.185390:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788684413.189642:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.192716:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073228416 00000100:00100000:1.0:1788684413.192738:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073228416 00010000:00010000:1.0:1788684413.192803:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f93 expref: 17 pid: 18403 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684413.192860:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:1.0:1788684413.192872:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+17:2392:x1875571073228416:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684413.192890:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684413.192898:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f93 expref: 17 pid: 18403 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.192914:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f93 expref: 17 pid: 18403 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.192942:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684413.192950:0:17157:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa1 expref: 17 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.192962:0:17157:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.192971:0:17157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.192998:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.193021:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684413.193098:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+17:2392:x1875571073228416:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 227us (3468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.193106:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00010000:00010000:0.0:1788684413.194028:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3400/0x44bac02bd54adb7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f93 expref: 16 pid: 18403 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684413.194056:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085879424:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684413.194086:0:17173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.194097:0:17173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.194104:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.194435:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.194451:0:17173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fbd expref: 16 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.194460:0:17173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.194500:0:17173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fbd expref: 16 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.194516:0:17173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fbd expref: 16 pid: 17173 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684413.194541:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085879552:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684413.194896:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684413.206454:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.206594:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085879552:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684413.206628:0:17173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684413.206989:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073228544 00000100:00100000:3.0:1788684413.207000:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073228544 00010000:00010000:3.0:1788684413.207052:0:17156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fbd expref: 17 pid: 17173 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684413.207090:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:3.0:1788684413.207100:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+17:2393:x1875571073228544:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684413.207118:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684413.207126:0:17156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fbd expref: 17 pid: 17173 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684413.207140:0:17156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fbd expref: 17 pid: 17173 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684413.207167:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3fe00/0x44bac02bd54adc04 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fbd expref: 17 pid: 17173 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684413.207208:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:3.0:1788684413.207214:0:17156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684413.207226:0:17156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684413.207235:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684413.207265:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684413.207346:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+16:2393:x1875571073228544:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 247us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684413.207354:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00010000:00010000:0.0:1788684413.208061:0:17173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.208075:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788684413.208222:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788684413.208407:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788684413.208449:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788684413.208546:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17173:1875571085879680:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788684413.208821:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684413.208869:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744a1e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788684413.210735:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085879680 00000100:00100000:3.0:1788684413.210755:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085879680 00000100:00100000:3.0:1788684413.210853:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788684413.210865:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17173:x1875571085879680:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788684413.211021:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17173:x1875571085879680:12345-0@lo:1000:mdt00_002.0 Request processed in 158us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684413.211031:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788684413.211409:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17173:1875571085879680:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788684413.211723:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788684413.211822:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17173:1875571085879808:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788684413.211892:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684413.211939:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788684413.212242:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085879808 00000100:00100000:2.0:1788684413.212250:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085879808 00000100:00100000:2.0:1788684413.212299:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788684413.212308:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17173:x1875571085879808:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788684413.212508:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17173:x1875571085879808:12345-0@lo:1000:mdt00_002.0 Request processed in 199us (615us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788684413.212516:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684413.213106:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17173:1875571085879808:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788684413.213173:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213186:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213194:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213201:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.213206:0:17173:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213215:0:17173:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213253:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:1.0:1788684413.213256:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684413.213262:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213270:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f800/0x44bac02bd54adc3c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213309:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213317:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213323:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213329:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.213331:0:17173:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213337:0:17173:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213345:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684413.213348:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684413.213357:0:17173:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa1 expref: 19 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213457:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa1 expref: 19 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213479:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa1 expref: 19 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.213551:0:17173:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa1 expref: 19 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684413.213925:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085879936:192.168.206.44@tcp:105: 00000100:00100000:1.0:1788684413.214032:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746044780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684413.218789:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.218963:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073228672 00000100:00100000:0.0:1788684413.218976:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073228672 00000100:00100000:0.0:1788684413.219050:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:0.0:1788684413.219063:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677cc60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+20:15646:x1875571073228672:12345-192.168.206.44@tcp:49:dd.0 00000100:00100000:0.0:1788684413.219224:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677cc60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+20:15646:x1875571073228672:12345-192.168.206.44@tcp:49:dd.0 Request processed in 164us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684413.219232:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:1.0:1788684413.220875:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17173:1875571085879936:192.168.206.44@tcp:105: 00010000:00010000:1.0:1788684413.220985:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.220999:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f400/0x44bac02bd54adb94 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221047:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221065:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221079:0:17173:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221090:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221096:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221121:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221127:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb2e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.221132:0:17173:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221315:0:17173:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221330:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684413.221333:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684413.221337:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221344:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc43 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221355:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221361:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221386:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221392:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684413.221396:0:17173:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221412:0:17173:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221421:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684413.221423:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788684413.221426:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.221432:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3f200/0x44bac02bd54adc35 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788684413.222468:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788684413.222479:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788684413.222513:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788684413.222523:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788684413.222680:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+19:15647:x1875571073228288:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 37693us (45080us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788684413.222703:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000020:00080000:1.0:1788684413.222710:0:17173:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788684413.234778:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684413.234905:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073228800 00000100:00100000:1.0:1788684413.234918:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073228800 00000100:00100000:1.0:1788684413.234997:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:1.0:1788684413.235009:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+19:15646:x1875571073228800:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:1.0:1788684413.235036:0:18403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684413.235062:0:18403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc4a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3fd9 expref: -99 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.235106:0:18403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adc51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.235143:0:18403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adc51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.235157:0:18403:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adc51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.235293:0:18403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2e00/0x44bac02bd54adc4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd9 expref: 21 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.235315:0:18403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adc51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd9 expref: 20 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.235325:0:18403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:1.0:1788684413.235328:0:18403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788684413.235333:0:18403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb2600, rc 0) 00000100:00100000:1.0:1788684413.235466:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+20:15646:x1875571073228800:12345-192.168.206.44@tcp:101:dd.0 Request processed in 458us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684413.235474:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:2.0:1788684413.237691:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.237805:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073229056 00000100:00100000:0.0:1788684413.237834:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073229056 00000100:00100000:0.0:1788684413.237902:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:0.0:1788684413.237914:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+20:15647:x1875571073229056:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788684413.238242:0:17174:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788684413.238281:0:17174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788684413.238320:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.238341:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.238354:0:17174:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.238407:0:17174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.238415:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.238422:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.238439:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788684413.238536:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+22:15647:x1875571073229056:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 624us (857us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788684413.238544:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000020:00080000:0.0:1788684413.238549:0:17174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788684413.238647:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684413.238656:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.238664:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3e800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684413.238669:0:17159:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.238678:0:17159:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.238716:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:1.0:1788684413.238719:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788684413.238724:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.238731:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e800/0x44bac02bd54adc58 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684413.238743:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684413.238745:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684413.238747:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684413.500580:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684413.500842:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073229184 00000100:00100000:3.0:1788684413.500856:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073229184 00000100:00100000:3.0:1788684413.500945:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:3.0:1788684413.500957:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:2393:x1875571073229184:12345-192.168.206.44@tcp:4:dd.0 00002000:00010000:3.0:1788684413.501031:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9d287c, atime: 0x6a9d287b, ctime: 0x6a9d287c, blocks: 0x0 00010000:00010000:3.0:1788684413.501042:0:18683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684413.501093:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788684413.501099:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684413.501107:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684413.501451:0:18683:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684413.507759:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684413.508315:0:18685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788684413.508329:0:18685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788684413.509058:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073229312 00000100:00100000:1.0:1788684413.509071:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073229312 00000100:00100000:0.0:1788684413.509901:0:20310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:0.0:1788684413.509921:0:20310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+8:2392:x1875571073229312:12345-192.168.206.44@tcp:4:dd.0 00010000:00010000:0.0:1788684413.509962:0:20310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.509979:0:20310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684413.509983:0:20310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684413.509990:0:20310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684413.510006:0:20310:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788684413.689269:0:19491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1788684413.689289:0:19491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788684413.689687:0:18683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788684413.689703:0:18683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788684412 -> 1788684413 00002000:00010000:2.0:1788684413.689706:0:18683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788684412 -> 1788684413 00002000:00010000:2.0:1788684413.689708:0:18683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788684413.689738:0:18683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.689751:0:18683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.689760:0:18683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.689767:0:18683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684413.689772:0:18683:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.689781:0:18683:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.689801:0:18683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.689809:0:18683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab502818/0x44bac02bd54adc5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684413.689963:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+7:2393:x1875571073229184:12345-192.168.206.44@tcp:4:dd.0 Request processed in 189003us (189395us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788684413.689979:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00010000:00010000:1.0:1788684413.694122:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788684413.779410:0:19491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788684413.787931:0:20310:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788684413.787940:0:20310:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788684413.787957:0:20310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.787984:0:20310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.787994:0:20310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.788000:0:20310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3fc00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684413.788005:0:20310:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.788014:0:20310:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.788032:0:20310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684413.788039:0:20310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073413045/0x44bac02bd54adc66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684413.788146:0:20310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2392:x1875571073229312:12345-192.168.206.44@tcp:4:dd.0 Request processed in 278227us (280397us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788684413.788156:0:20310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:0.0:1788684414.589821:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085880192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684414.589893:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684414.589940:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085880192 00000100:00100000:0.0:1788684414.589940:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684414.589946:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085880064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684414.589948:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085880192 00000100:00100000:0.0:1788684414.589969:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684414.589987:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085880064 00000100:00100000:3.0:1788684414.589991:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085880064 00000100:00100000:0.0:1788684414.589999:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788684414.590007:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788684414.590007:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085880192:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684414.590012:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085880064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684414.590037:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000004:00000024:0.0:1788684414.590037:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788684414.590077:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085880064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684414.590088:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788684414.590199:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684414.590209:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085880320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684414.590241:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684414.590313:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085880320 00000100:00100000:3.0:1788684414.590319:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085880320 00000100:00100000:3.0:1788684414.590385:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684414.590393:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085880320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684414.590429:0:18682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684414.590474:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085880320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684414.590482:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684414.590520:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085880320:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788684414.590717:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684414.594425:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085880192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4406us (4518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684414.594440:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788684414.594968:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085880064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684414.594994:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085880192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788684414.717521:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684415.746046:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788684415.877129:0:20347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:0.0:1788684416.317970:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788684416.317978:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788684416.318012:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788684416.318021:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788684416.640547:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085880448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684416.640614:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684416.642449:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085880448 00000100:00100000:1.0:1788684416.642463:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085880448 00000100:00100000:1.0:1788684416.642525:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788684416.642537:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085880448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684416.642579:0:18682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788684416.650254:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085880832:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.651055:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085880576:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.655358:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.655433:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085881344:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.655464:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.655484:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085881856:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.655518:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.655559:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788684416.655566:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085880960:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.655590:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.655607:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085881472:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.655627:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.655646:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085881984:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.655665:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.655715:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085880832 00000100:00100000:0.0:1788684416.655722:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085880832 00000100:00100000:0.0:1788684416.655766:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085881344 00000100:00100000:0.0:1788684416.655769:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085881344 00000100:00100000:0.0:1788684416.655787:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085881472 00000100:00100000:0.0:1788684416.655789:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085881472 00000100:00100000:0.0:1788684416.655803:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788684416.655810:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085880832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.655831:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.655867:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085880832:12345-0@lo:400:kworker.0 Request processed in 56us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.655873:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085881088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684416.655878:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788684416.655895:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788684416.655911:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085881344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.655917:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684416.655932:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085881600:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.655950:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085881344:12345-0@lo:400:kworker.0 Request processed in 41us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684416.655961:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788684416.655964:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.655977:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788684416.655985:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085881472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.655988:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085882112:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.656020:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.656026:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085881472:12345-0@lo:400:kworker.0 Request processed in 41us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684416.656032:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788684416.656052:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085881856 00000100:00100000:0.0:1788684416.656056:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085881856 00000100:00100000:0.0:1788684416.656073:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085880960 00000100:00100000:0.0:1788684416.656075:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085880960 00000100:00100000:0.0:1788684416.656083:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085881984 00000100:00100000:0.0:1788684416.656085:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085881984 00000100:00100000:0.0:1788684416.656093:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085881600 00000100:00100000:0.0:1788684416.656095:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085881600 00000100:00100000:0.0:1788684416.656103:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085882112 00000100:00100000:0.0:1788684416.656105:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085882112 00000100:00100000:0.0:1788684416.656114:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788684416.656119:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085881856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.656134:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788684416.656144:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085880704:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.656151:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085881856:12345-0@lo:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684416.656157:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788684416.656170:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788684416.656177:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.656180:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085880960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.656200:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085881216:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.656359:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085880960:12345-0@lo:400:kworker.0 Request processed in 181us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.656360:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684416.656398:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788684416.656406:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085881728:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.656415:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788684416.656424:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085881984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.656433:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684416.656459:0:18681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788684416.656465:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085881984:12345-0@lo:400:kworker.0 Request processed in 41us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.656470:0:18681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788684416.656475:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788684416.656489:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085881728 00000100:00080000:2.0:1788684416.656490:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684416.656494:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085881728 00000100:00080000:2.0:1788684416.656496:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684416.656500:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684416.656503:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684416.656505:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684416.656516:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788684416.656523:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085881600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.656560:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085880576 00000100:00100000:2.0:1788684416.656564:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085880576 00000100:00100000:2.0:1788684416.656590:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788684416.656597:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:3625:x1875571085880576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.656629:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:3625:x1875571085880576:12345-0@lo:400:kworker.0 Request processed in 33us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.656636:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788684416.656665:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788684416.656672:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085882112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657197:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085882112:12345-0@lo:400:kworker.0 Request processed in 525us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.657203:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788684416.657221:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788684416.657227:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085881728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657253:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085881728:12345-0@lo:400:kworker.0 Request processed in 27us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.657258:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788684416.657290:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085880704 00000100:00100000:2.0:1788684416.657295:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085880704 00000100:00100000:0.0:1788684416.657305:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085881600:12345-0@lo:400:kworker.0 Request processed in 780us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684416.657313:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788684416.657324:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085881216 00000100:00100000:2.0:1788684416.657329:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085881216 00000100:00100000:2.0:1788684416.657348:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684416.657354:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788684416.657357:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085880704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.657386:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085881216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657413:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085880704:12345-0@lo:400:kworker.0 Request processed in 58us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.657419:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684416.657490:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085881216:12345-0@lo:400:kworker.0 Request processed in 127us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684416.657498:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788684416.657532:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085880704:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.657539:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085880960:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657557:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085881216:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657566:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085881728:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657574:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085880576:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657584:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085881600:0@lo:400:kworker.0 00010000:00080000:2.0:1788684416.657595:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648599f80 x1875571085882112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684416.657604:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085882112:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657633:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684416.657637:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085881472:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657648:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085882240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684416.657653:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085881984:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.657669:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085880832:0@lo:400:kworker.0 00000100:00100000:0.0:1788684416.657696:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085881344:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657697:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788684416.657722:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa83100 x1875571085881856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684416.657733:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085881856:0@lo:400:kworker.0 00000100:00100000:2.0:1788684416.657741:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085881088 00000100:00100000:2.0:1788684416.657746:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085881088 00000100:00100000:2.0:1788684416.657771:0:18681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788684416.657783:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085882240 00000100:00100000:2.0:1788684416.657786:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085882240 00000100:00100000:2.0:1788684416.657870:0:20360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788684416.657877:0:20360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085881088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684416.658223:0:20360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684416.658319:0:20360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085881088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 441us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.658327:0:20360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788684416.658361:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085881088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684416.658407:0:20360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684416.658414:0:20360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085882240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684416.658432:0:20360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788684416.658464:0:20360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085882240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.658470:0:20360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684416.658493:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085882240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788684416.662025:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085880448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 19482us (21401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684416.662039:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684416.662192:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1788684416.662200:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d6648667b80, transno 8589934596 00000004:00080000:2.0:1788684416.662218:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1788684416.662247:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085880448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684416.697757:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684416.697864:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684416.697899:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684416.697961:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073229824 00000100:00100000:1.0:1788684416.697974:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073229824 00000100:00100000:1.0:1788684416.698079:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:1.0:1788684416.698090:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2390:x1875571073229824:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684416.698198:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2390:x1875571073229824:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684416.698206:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00080000:1.0:1788684416.698234:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684416.711661:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684416.711720:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684416.711749:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684416.712182:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073229568 00000100:00100000:2.0:1788684416.712197:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073229568 00000100:00100000:2.0:1788684416.712443:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073230080 00000100:00100000:2.0:1788684416.712447:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073230080 00000100:00100000:2.0:1788684416.712479:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:2.0:1788684416.712492:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+22:2390:x1875571073229568:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684416.712664:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+22:2390:x1875571073229568:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 173us (14919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.712683:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:2.0:1788684416.712707:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:2.0:1788684416.712715:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2390:x1875571073230080:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684416.712748:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2390:x1875571073230080:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 34us (14848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684416.712755:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:3.0:1788684416.712844:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073229440 00000100:00100000:3.0:1788684416.712852:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073229440 00000100:00100000:3.0:1788684416.712889:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 169 00000100:00100000:3.0:1788684416.712896:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+13:2390:x1875571073229440:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684416.712927:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+13:2390:x1875571073229440:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 31us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684416.712933:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 169 00000100:00100000:3.0:1788684416.712972:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073230336 00000100:00100000:3.0:1788684416.712977:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073230336 00000100:00100000:3.0:1788684416.713008:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:3.0:1788684416.713016:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2390:x1875571073230336:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684416.713044:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2390:x1875571073230336:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 30us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684416.713050:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00080000:3.0:1788684416.713089:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684416.713095:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684416.713824:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684416.713849:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684416.713868:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684416.713889:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073229952 00000100:00100000:0.0:1788684416.713895:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073229952 00000100:00100000:0.0:1788684416.713928:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073230464 00000100:00100000:0.0:1788684416.713930:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073230464 00000100:00100000:0.0:1788684416.713947:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:0.0:1788684416.713954:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2390:x1875571073229952:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684416.713994:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2390:x1875571073229952:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 40us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684416.714000:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:0.0:1788684416.714013:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:0.0:1788684416.714018:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2390:x1875571073230464:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684416.714037:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2390:x1875571073230464:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 18us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684416.714054:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:0.0:1788684416.714070:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073229696 00000100:00100000:0.0:1788684416.714074:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073229696 00000100:00100000:0.0:1788684416.714096:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073230208 00000100:00100000:0.0:1788684416.714098:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073230208 00000100:00100000:0.0:1788684416.714112:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:0.0:1788684416.714117:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2390:x1875571073229696:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684416.714146:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2390:x1875571073229696:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 29us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684416.714153:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:0.0:1788684416.714164:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:0.0:1788684416.714171:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2390:x1875571073230208:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684416.714192:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2390:x1875571073230208:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684416.714198:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00080000:0.0:1788684416.714214:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684416.714218:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788684416.765900:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41973 lines, 41973 kept, 0 dropped, 0 bad.